Surgical robot system for multi-user simultaneous operation
By designing the connection between multiple slave tools and main operators, combining control devices and visual equipment, the problem that the existing system cannot take into account multiple types of surgery and multiple people are simultaneously operated, and complex surgical operations with multiple people simultaneously operated are realized. , improves the flexibility and operating accuracy of the system.
Patent Information
- Application Number
- PCT/CN2024/091446
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-10-31
- Filing Date
- 2024-05-07
- Publication Date
- 2024-11-21
AI Technical Summary
The existing surgical robot system cannot take into account multiple types of surgery at the same time, and multiple medical staff are required to operate multiple surgical tools at the same time in complex operations, resulting in challenges in system design.
A surgical robot system is designed, including multiple slave tools and master operators, connected by control devices, allowing multiple operators to operate remotely simultaneously, achieving compatibility of multiple surgical types, and through master-slave mapping and vision The coordination of the equipment improves operating accuracy and intuitiveness.
It realizes complex surgical operations with multiple people simultaneously, improves the flexibility and operation accuracy of the surgical robot system, meets multiple surgical needs, and improves medical efficiency.
Smart Images

Figure CN2024091446_21112024_PF_FP_ABST
Abstract
Description
Surgical robot system for simultaneous operation by multiple people Technical Field
[0001] The present disclosure relates to the field of robot control, and in particular to a surgical robot system for simultaneous operation by multiple persons. Background Art
[0002] With the development of science and technology, the use of surgical robots to assist medical staff in performing surgery has developed rapidly. Surgical robots can not only help medical staff perform a series of medical diagnoses and auxiliary treatments, but also effectively alleviate the shortage of medical resources.
[0003] Current surgical robotic systems are typically designed for specific surgical procedures, such as laparoscopic, orthopedic, and neurosurgery, and are unable to simultaneously handle multiple surgical procedures. Furthermore, complex surgeries sometimes require multiple medical staff to operate multiple surgical tools simultaneously, posing significant challenges to the design of surgical robotic systems.
[0004] Summary of the Invention
[0005] In some embodiments, the present disclosure provides a surgical robot system, comprising: a plurality of slave tools, the plurality of slave tools including at least a first slave tool, a second slave tool, a third slave tool and a fourth slave tool; a plurality of master manipulators, the plurality of master manipulators including at least a first left-hand master manipulator, a first right-hand master manipulator, a second left-hand master manipulator and a second right-hand master manipulator; and a control device, connected to the plurality of slave tools and the plurality of master manipulators, and configured to control the slave instrument movement of the first slave tool, the second slave tool, the third slave tool and the fourth slave tool based on the movement of the handles of the first left-hand master manipulator, the first right-hand master manipulator, the second left-hand master manipulator and the second right-hand master manipulator. BRIEF DESCRIPTION OF THE DRAWINGS
[0006] To more clearly illustrate the technical solutions in the embodiments of the present disclosure, the following briefly describes the drawings required for describing the embodiments of the present disclosure. The drawings described below only illustrate some embodiments of the present disclosure. Those skilled in the art can, without inventive effort, derive other embodiments based on the contents of the embodiments of the present disclosure and these drawings.
[0007] FIG1A shows a structural block diagram of a surgical robot system according to some embodiments of the present disclosure;
[0008] FIG. 1B shows a structural block diagram of a surgical robot system according to other embodiments of the present disclosure.
[0009] FIG2 is a schematic structural diagram of a surgical robot system according to some embodiments of the present disclosure;
[0010] FIG3 shows a schematic structural diagram of a first main control vehicle according to some embodiments of the present disclosure;
[0011] FIG4 shows a schematic structural diagram of a first left-hand master operator according to some embodiments of the present disclosure;
[0012] FIG5A shows a schematic diagram of a first surgical trolley according to some embodiments of the present disclosure;
[0013] FIG5B shows a schematic structural diagram of an RCM mechanism according to some embodiments of the present disclosure;
[0014] FIG5C shows a schematic diagram of a first operating table according to other embodiments of the present disclosure;
[0015] FIG6 shows a schematic diagram of a second operating table according to some embodiments of the present disclosure;
[0016] FIG7 is a schematic diagram illustrating observation of an operating area by a dynamic vision device according to some embodiments of the present disclosure;
[0017] FIG8 shows a schematic diagram of an equipment cart according to some embodiments of the present disclosure;
[0018] FIG9 is a schematic diagram illustrating a dispensing state of a driven tool according to some embodiments of the present disclosure;
[0019] FIG10A shows a schematic diagram of a coordinate system in remote teleoperation according to some embodiments of the present disclosure;
[0020] FIG10B is a schematic diagram showing a coordinate system in remote teleoperation according to other embodiments of the present disclosure;
[0021] FIG11 is a schematic diagram illustrating an allocation state of a slave visual device according to some embodiments of the present disclosure. DETAILED DESCRIPTION
[0022] In order to make the technical problems solved by the present disclosure, the technical solutions adopted and the technical effects achieved more clear, the technical solutions of the embodiments of the present disclosure will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only exemplary embodiments of the present disclosure, rather than all embodiments.
[0023] In the description of the present disclosure, it should be noted that the terms "center", "up", "down", "left", "right", "vertical", "horizontal", "inside", "outside" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present disclosure and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as a limitation on the present disclosure. In addition, the terms "first" and "second" are only used for descriptive purposes and cannot be understood as indicating or implying relative importance. In the description of the present disclosure, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected" and "coupled" should be understood in a broad sense, for example, it can be a fixed connection or a detachable connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be a communication between the two elements. For those of ordinary skill in the art, the specific meanings of the above terms in the present disclosure can be understood according to the specific circumstances.
[0024] In the present disclosure, the end close to the operator (e.g., a surgeon) is defined as the proximal end, near portion, or rear end, and the end opposite to the proximal end, near portion, or rear end, and the end opposite to the distal end, far portion, or front ...
[0025] In the present disclosure, the term "position" refers to the positioning of an object or a part of an object in three-dimensional space (for example, three translational degrees of freedom can be described using changes in Cartesian X, Y, and Z coordinates, such as three translational degrees of freedom along the Cartesian X, Y, and Z axes, respectively). In the present disclosure, the term "posture" refers to the rotational setting of an object or a part of an object (for example, three rotational degrees of freedom, which can be described using roll, pitch, and yaw). In the present disclosure, the term "pose" refers to the combination of the position and pose of an object or a part of an object, for example, which can be described using six parameters of the six degrees of freedom mentioned above. In the present disclosure, the pose of the handle of the master manipulator can be represented by a set of joint information of the master manipulator joints (for example, a one-dimensional matrix composed of these joint information). The pose of the slave instrument of the slave tool can be determined by the drive information of the slave tool (for example, the drive information of the tool arm of the slave tool). In the present disclosure, the joint information of the joint can include the angle of rotation of the corresponding joint relative to the corresponding joint axis or the distance moved relative to the initial position.
[0026] In this disclosure, a reference coordinate system can be understood as a coordinate system that can describe the position and posture of an object. Depending on the actual positioning requirements, the reference coordinate system can be selected to have the origin of a virtual reference object or the origin of a physical reference object as the coordinate system origin. In some embodiments, the reference coordinate system can be a world coordinate system or a coordinate system of the space where the master manipulator, slave tool, slave vision device, image acquisition device is located, or the operator's own perception coordinate system, etc.
[0027] In this disclosure, an object can be understood as an object or target to be positioned, such as a tool arm or the end of a tool arm of a driven tool. The pose of a tool arm or a portion thereof (e.g., the end thereof) can refer to the pose of a coordinate system defined by the tool arm or a portion thereof relative to a reference coordinate system.
[0028] FIG1A shows a block diagram of a surgical robot system 100 according to some embodiments of the present disclosure. In some embodiments, as shown in FIG1A , the surgical robot system 100 may include a plurality of master manipulators, a plurality of slave tools, and a control device 150. A plurality of master manipulators (for example, the first left-hand master manipulator 111a, the first right-hand master manipulator 111b, the second left-hand master manipulator 112a, the second right-hand master manipulator 112b shown in FIG1A or FIG1B , the first left-hand master manipulator 211a, the first right-hand master manipulator 211b, the second left-hand master manipulator 221a, the second right-hand master manipulator 221b shown in FIG2 , the first left-hand master manipulator 301a, the first right-hand master manipulator 301b shown in FIG3 , the first left-hand master manipulator 401 shown in FIG4 00. The first left-hand main manipulator 911a, the first right-hand main manipulator 911b, the second left-hand main manipulator 921a, the second right-hand main manipulator 921b shown in FIG9 or the first left-hand main manipulator 1111a, the first right-hand main manipulator 1111b, the second left-hand main manipulator 1121a, the second right-hand main manipulator 1121b shown in FIG11 function as the operating end of the surgical robot system 100 to allow multiple operators (for example, two operators) to perform remote operation at the same time. a plurality of driven tools (for example, the first driven tool 131, the second driven tool 132, the third driven tool 133, the fourth driven tool 134 shown in FIG. 1A or FIG. 1B , the driven tool 231, the fourth driven tool 241 shown in FIG. 2 , the first driven tool 530, the second driven tool 540, the third driven tool 550 shown in FIG. 5A and FIG. 5C , the fourth driven tool 630 shown in FIG. 6 , the first driven tool 710, the second driven tool 720, the third driven tool 711 shown in FIG. 7 The third slave tool 730, the fourth slave tool 740, the first slave tool 931, the second slave tool 932, the third slave tool 933, the fourth slave tool 941, and the fifth slave tool 951 shown in FIG9 , or the first slave tool 1131, the second slave tool 1132, the third slave tool 1133, and the fourth slave tool 1141 shown in FIG11 , function as the working end of the surgical robot system 100 to simultaneously perform surgical operations under teleoperation. The control device 150 can be connected to multiple master manipulators and multiple slave tools, and based on the movement of the master manipulators, controls the movement of the slave tools associated with the master manipulators to perform surgical operations.
[0029] In some embodiments, the multiple master manipulators may include at least four master manipulators, such as the first left-hand master manipulator 111a, the first right-hand master manipulator 111b, the second left-hand master manipulator 112a, and the second right-hand master manipulator 112b shown in FIG1A, so that at least two operators can perform remote operation simultaneously. The multiple slave tools may include at least four slave tools, such as the first slave tool 131, the second slave tool 132, the third slave tool 133, and the fourth slave tool 134 shown in FIG1A, so that surgical operations can be performed simultaneously under remote operation by at least two operators. It should be understood by those skilled in the art that the number of master manipulators and slave tools is not limited to the above. For example, the number of master manipulators and slave tools can be greater than four respectively, and the number of master manipulators and slave tools can also be inconsistent. The number of master manipulators and slave tools of the surgical robot system can be adjusted according to actual needs.
[0030] In some embodiments, the master manipulator may include a robotic arm (e.g., robotic arm 401 shown in FIG4 ) and a handle disposed at the end of the robotic arm (e.g., handle 402 shown in FIG4 ). In some embodiments, the robotic arm may be a robotic arm having multiple degrees of freedom composed of multiple joints, for example, a robotic arm capable of 4 to 7 degrees of freedom, as described in detail below.
[0031] In some embodiments, the slave tool may include a tool arm and a slave instrument disposed at the end of the tool arm. In some embodiments, the tool arm may be a flexible arm, for example, a continuum deformable arm capable of controllably bending. In some embodiments, the slave instrument may be a surgical instrument such as surgical forceps, electric cutters, electric hooks, and electric coagulation. It should be understood that the first to fourth slave tools are not limited to the above-mentioned structures, for example, they may also be straight rod-type slave tools, or passive flexible slave tools. In the surgical robot system, the plurality of slave tools may be a combination of at least one flexible slave tool and one other type of slave tool, for example, a combination of three flexible slave tools and one straight rod-type slave tool. In some embodiments, at least one of the multiple slave tools, for example, the fourth slave tool (for example, the fourth slave tool 134 shown in Figure 1A or 1B, the fourth slave tool 241 shown in Figure 2, the fourth slave tool 630 shown in Figure 6, the fourth slave tool 740 shown in Figure 7, the fourth slave tool 941 shown in Figure 9, or the fourth slave tool 1141 shown in Figure 11) may include at least one of a laparoscopic system surgical tool, an orthopedic surgical tool, a neurosurgery tool, a puncture surgical tool, an interventional surgical tool, and a transurethral bladder surgical tool, the details of which will be described later.
[0032] In some embodiments, the control device 150 can be connected to multiple master manipulators and multiple slave tools, and based on the movement of the handle of at least one of the multiple master manipulators, control the movement of the slave instrument of at least one of the multiple slave tools to achieve surgical operations. In some embodiments, the control device 150 can generate control signals for the slave tools associated with the master manipulators based on the movement of the handles of the multiple master manipulators, and the control device 150 can be connected to the drive device (such as a servo motor) of the slave tool in communication and send control signals to the drive device, so that the drive device controls the movement of the slave instruments of the multiple slave tools based on the control signals. For example, the control device 150 can send control signals to the drive device of the slave tool via the CAN bus to control the movement of the slave instrument of the slave tool to the corresponding target posture or perform the corresponding surgical operation to achieve surgical operations. It can be understood that the control device 150 can be a single controller with a centralized setting, or can include multiple controllers with a distributed setting.
[0033] In some embodiments, the surgical robot system may further include a slave vision device (e.g., the slave vision device 141 shown in FIG. 1B , the slave vision device 234 shown in FIG. 2 , the slave vision device 750 shown in FIG. 7 , or the slave vision device 1160 shown in FIG. 11 ). The slave vision device may be used to capture images of the operating area and transmit the captured images to the master trolley. After being processed by the video processing module in the master trolley, the image is displayed on the display of the master trolley (e.g., the stereo display 302 of the first master trolley 300 shown in FIG. 3 or the master external display 303). The operator obtains the position and posture of the slave instrument of at least one slave tool relative to the reference coordinate system in real time through the image in the display. The posture of the image of the slave instrument of at least one slave tool in the display relative to the reference coordinate system is the posture of the slave instrument perceived by the operator, and the posture of the handle of at least one master manipulator relative to the reference coordinate system is the posture of the handle perceived by the operator. The posture change experienced by the operator through remote manipulation of the handle of at least one master manipulator and the posture change of the slave instrument of at least one slave tool perceived by the operator on the display conform to a preset posture relationship. Thus, by remotely manipulating at least one master manipulator, the posture change of the handle of at least one master manipulator is converted into the posture change of the slave instrument of at least one slave tool based on the preset posture relationship, thereby achieving posture control of the slave instrument of at least one slave tool. In this way, when the operator grasps the handle of at least one master manipulator and moves it to operate the slave instrument of at least one associated slave tool, based on the principle of intuitive operation, the posture change of the slave instrument of at least one slave tool perceived by the operator is consistent with the posture change of the handle of at least one master manipulator perceived by the operator, which helps to improve the operator's remote operation experience and remote operation accuracy.
[0034] In some embodiments, the slave vision device may include an endoscopic camera for capturing real-time images of an operating area (e.g., a surgical area within a patient's body). The slave vision device may include, but is not limited to, a dual-lens slave vision device or a single-lens slave vision device, such as a binocular or monocular camera. In some embodiments, the slave vision device may implement at least one of visible light band imaging, infrared band imaging, CT (Computed Tomography) imaging, and acoustic wave imaging. Depending on the type of image collected, those skilled in the art may select different slave vision devices as the slave vision device.
[0035] In some embodiments, the slave vision device may include an imaging tool arm (e.g., imaging tool arm 751 shown in FIG. 7 ) and an endoscopic camera (e.g., endoscopic camera 752 shown in FIG. 7 ) disposed at the end of the imaging tool arm to capture real-time images of an operating area (e.g., a surgical area within a patient's body). Similar to the tool arm of the slave tool, the imaging tool arm may be a flexible arm, such as a continuous deformable arm capable of controllable bending. In some embodiments, the endoscopic camera may include at least one imaging unit and at least one illumination unit. The imaging unit may be disposed at the front end of the endoscopic camera and may, for example, be a CCD camera comprising an image sensor and an imaging lens. In some embodiments, the at least one imaging unit may include a standard imaging unit and a wide-angle imaging unit. The standard imaging unit may be used for imaging in normal operating modes (e.g., surgical operating modes) to provide high-definition images of the operating area. The wide-angle imaging unit has a larger field of view than the standard imaging unit and may be used for imaging in special operating modes (e.g., switching between multiple surgical tools or searching for dropped objects). The illumination unit may be used to provide illumination for the imaging unit to capture images.
[0036] In the present disclosure, the surgical robot system can be a modular surgical robot system, for example, including multiple master control modules for remote operation by multiple operators, multiple surgical modules for performing surgical operations, and a control module connected to the multiple master control modules and the multiple surgical modules. FIG1B shows a block diagram of a surgical robot system 100′ according to other embodiments of the present disclosure.
[0037] In some embodiments, as shown in FIG1B , the surgical robot system 100 ′ may include multiple master manipulators, multiple surgical trolleys, and control devices. Multiple master manipulators (for example, the first left-hand master manipulator 111a, the first right-hand master manipulator 111b, the second left-hand master manipulator 112a, the second right-hand master manipulator 112b shown in FIG1A or FIG1B , the first left-hand master manipulator 211a, the first right-hand master manipulator 211b, the second left-hand master manipulator 221a, the second right-hand master manipulator 221b shown in FIG2 , the first left-hand master manipulator 301a, the first right-hand master manipulator 301b shown in FIG3 , the first left-hand master manipulator 400 shown in FIG4 , the second right-hand master manipulator 401 shown in FIG9 ) The first left-hand main manipulator 911a, the first right-hand main manipulator 911b, the second left-hand main manipulator 921a, the second right-hand main manipulator 921b shown in the figure, or the first left-hand main manipulator 1111a, the first right-hand main manipulator 1111b, the second left-hand main manipulator 1121a, the second right-hand main manipulator 1121b shown in Figure 11 function as the main control module of the surgical robot system 100' or the operating elements in the main control module to allow multiple operators (for example, two operators) to perform remote operation at the same time. A plurality of operating trolleys (for example, the first operating trolley 130 and the second operating trolley 140 shown in FIG. 1B , the first operating trolley 230 and the second operating trolley 240 shown in FIG. 2 , the first operating trolley 500 shown in FIG. 5A , the first operating trolley 500′ shown in FIG. 5C , the second operating trolley 600 shown in FIG. 6 , or the first operating trolley 1010 and the second operating trolley 1020 shown in FIG. 10A ) function as operating modules of the surgical robot system 100 ′, and the plurality of operating trolleys are used to carry a plurality of slave tools (for example, the first slave tool 131, the second slave tool 132, the third slave tool 133, and the fourth slave tool 134 shown in FIG. 1A or FIG. 1B , the slave tool 231 and the fourth slave tool 241 shown in FIG. 2 , the first slave tool 530 and the second slave tool 530 shown in FIG. 5A and FIG. 5C ). 11 ) and a slave vision device (for example, the slave vision device 141 shown in FIG1B , the slave vision device 234 shown in FIG2 , the slave vision device 750 shown in FIG7 , or the slave vision device 1160 shown in FIG11 ) to simultaneously perform surgical operations under the remote operation of multiple master manipulators.The control device 150 can serve as a control module of the surgical robot system 100 ′ and be connected to multiple master manipulators and multiple slave tools. Based on the movement of the master manipulators, the control device 150 controls the movement of the slave tools associated with the master manipulators to perform surgical operations.
[0038] In some embodiments, the surgical robot system may further include one or more master control trolleys (e.g., the first master control trolley 110 and the second master control trolley 120 shown in FIG. 1B , the first master control trolley 210 and the second master control trolley 220 shown in FIG. 2 , or the first master control trolley 300 shown in FIG. 3 ) as master control modules to carry multiple master manipulators. For example, as shown in FIG. 1B , the surgical robot system 100 ′ may include a first master control trolley 110 and a second master control trolley 120 operated by a first operator and a second operator, respectively. The first master control trolley 110 is used to carry a first left-hand master manipulator 111a and a first right-hand master manipulator 111b, and the second master control trolley 120 is used to carry a second left-hand master manipulator 121a and a second right-hand master manipulator 121b.
[0039] In some embodiments, the plurality of operating trolleys may include at least two operating trolleys, such as a first operating trolley (e.g., the first operating trolley 130 shown in FIG. 1B , the first operating trolley 230 shown in FIG. 2 , the first operating trolley 500 shown in FIG. 5A , the first operating trolley 500′ shown in FIG. 5C , or the first operating trolley 1010 shown in FIG. 10A ) and a second operating trolley (e.g., the second operating trolley 140 shown in FIG. 1B , the second operating trolley 240 shown in FIG. 2 , the second operating trolley 600 shown in FIG. 6 , or the second operating trolley 1020 shown in FIG. 10A ). The plurality of slave tools may include at least four slave tools (e.g., the first slave tool 131 , the second slave tool 132 , the third slave tool 133 , the fourth slave tool 134 , etc. shown in FIG. 1A or FIG. 1B ). The plurality of slave tools and slave vision devices may be mounted on the plurality of operating trolleys, respectively. In some embodiments, as shown in FIG1B , multiple surgical trolleys may be configured such that a first surgical trolley is used to carry at least a first slave tool 131, a second slave tool 132, a third slave tool 133, and a slave vision device 141, and a second surgical trolley is used to carry at least a fourth slave tool 134. It should be understood that the configuration of the multiple surgical trolleys is not limited to the above. In some embodiments, the fourth slave tool 134 may be carried by the first surgical trolley, while the slave vision device 141 may be carried by the second surgical trolley. For example, the multiple surgical trolleys may also be configured such that a first surgical trolley 130 is used to carry the first slave tool 131, the second slave tool 132, the third slave tool 133, and the fourth slave tool 134, and a second surgical trolley 140 is used to carry the slave vision device 141.
[0040] In some embodiments, the surgical trolley may be equipped with a drive device for driving multiple slave tools. These slave tools are mounted on the trolley and connected to the drive device, as described below. A master control trolley equipped with multiple master manipulators is communicatively connected to the trolley to control the multiple slave tools during surgical procedures. The master control trolley and the trolley may be connected via wired or wireless transmission, for example.
[0041] In some embodiments, the surgical robot system may further include an equipment trolley as an auxiliary module for carrying a display device and a positioning sensing unit, etc., the details of which will be described later.
[0042] In the present disclosure, the surgical robot system 100, 100' can allow a first operator to operate the first left-hand master manipulator 111a and the first right-hand master manipulator 111b to control the slave tools (for example, the first slave tool 131 and the second slave tool 132 shown in Figure 1A or Figure 1B) associated with the first left-hand master manipulator 111a and the first right-hand master manipulator 111b, respectively, and can allow a second operator to operate the second left-hand master manipulator 112a and the second right-hand master manipulator 112b to control the slave tools (for example, the third slave tool 133 and the fourth slave tool 134 shown in Figure 1A or Figure 1B) associated with the second left-hand master manipulator 112a and the second right-hand master manipulator 112b, respectively, thereby realizing complex surgical operations in which two operators remotely operate at least four slave tools at the same time. The specific content will be described later.
[0043] In the present disclosure, the surgical robot system 100, 100' can be compatible with single-port surgical operations, single-multi-port combined operations or multi-port surgical operations. In some embodiments, at least a portion of the tool arms of the first to fourth slave tools 131-134 and the slave instruments provided at the end of the tool arms are configured to be able to enter the operating area through a surgical connection device (such as the surgical connection device 270 described in Figure 2 or the surgical connection device 570 shown in Figure 5A or Figure 5C) inserted into an opening (such as an incision or a natural opening) formed on the patient's body, so as to perform surgical operations simultaneously under the remote operation of the first operator and the second operator, thereby realizing single-port multi-tool surgical operations. Alternatively, the first to fourth slave tools 131-134 can be configured to enter the operating area through multiple surgical connection devices inserted into multiple openings formed on the patient's body, so as to perform surgical operations simultaneously under the remote operation of the first operator and the second operator, thereby realizing multi-port multi-tool surgical operations. In some embodiments, the surgical connection device can be, for example, a tube sleeve, a sheath sleeve, etc. Those skilled in the art should understand that the surgical robot systems 100 and 100 ′ can be applied to special or general robotic systems in multiple medical fields, such as laparoscopic surgical robot systems.
[0044] FIG2 is a schematic diagram illustrating the structure of a surgical robot system 200 according to some embodiments of the present disclosure. In some embodiments, as shown in FIG2 , the surgical robot system 200 may include multiple master control trolleys serving as master control modules, such as a first master control trolley 210 and a second master control trolley 220. The first master control trolley 210 may be used to carry a first master manipulator, which may include a first left-hand master manipulator 211a and a first right-hand master manipulator 211b. The second master control trolley 220 may be used to carry a second master manipulator, which may include a second left-hand master manipulator 221a and a second right-hand master manipulator 221b.
[0045] FIG3 illustrates a schematic structural diagram of a first master control trolley 300 in accordance with some embodiments of the present disclosure. In some embodiments, as shown in FIG3 , the first master control trolley 300 includes a first master operator (e.g., a first left-hand master operator 301a and a first right-hand master operator 301b), a master control trolley display (e.g., displays 302-304), and pedals (e.g., pedals 305-307). A control device (e.g., the control device 150 shown in FIG1A or FIG1B ) is communicatively connected to the first master operator, the master control trolley display, and the pedals, respectively, to exchange signals with the first master operator, the master control trolley display, and the pedals, and to generate corresponding control instructions based on the collected control information.
[0046] In some embodiments, the master trolley display may include a stereoscopic display 302, a master external display 303, and a master touch display 304. The stereoscopic display 302 is used to display an image of the surgical area (e.g., a stereoscopic image of the surgical area) and system status prompts to the first operator operating the first master trolley 300. The master external display 303 is used to display an image of the surgical area and system status prompts to external users. The touch display 304 is used to display the software user interface of the first master trolley 300. In some embodiments, the image displayed on the stereoscopic display 302 or the master external display 303 can be determined based on an image acquired by a slave visual device (e.g., the slave visual device 234 shown in FIG. 2 , the slave visual device 750 shown in FIG. 7 , or the slave visual device 1160 shown in FIG. 11 ). In some embodiments, the master trolley pedals can be used to capture input from the first operator's feet, such as instrument pedals (e.g., electro-resection pedal 305, electro-coagulation pedal 306), clutch pedal 307, field of view pedal (not shown), and switching pedal (not shown). Among them, the instrument pedal is used to control the surgical instrument arranged at the end of the slave tool, the clutch pedal 307 is used to disconnect the master-slave mapping between the first master manipulator and the associated surgical tool, the field of view pedal is used to obtain control of the slave visual device (for example, the slave visual device 234 shown in Figure 2, the slave visual device 750 shown in Figure 7, or the slave visual device 1160 shown in Figure 11), thereby allowing the first operator to remotely operate the slave visual device to adjust the observation field of view, and the switching pedal is used to quickly switch the control of the surgical tools between multiple surgical tools when a master manipulator is assigned multiple surgical tools (for example, two surgical tools).
[0047] In some embodiments, as shown in FIG3 , the first master manipulator may include a first left-hand master manipulator 301a and a first right-hand master manipulator 301b corresponding to the first operator's left-hand operation, respectively. In a practical scenario, the first master manipulator (including the first left-hand master manipulator 301a and the first right master manipulator 301b) is used to collect the first operator's operation input. The first operator controls the movement of the associated slave tool (e.g., the first slave tool 131, the second slave tool 132, the third slave tool 133, the fourth slave tool 134, etc. shown in FIG1A or FIG1B ) or the slave visual device (e.g., the slave visual device 141 shown in FIG1B , the slave visual device 234 shown in FIG2 , the slave visual device 750 shown in FIG7 , or the slave visual device 1160 shown in FIG11 ) in the operation area by remotely operating the first master manipulator. It should be understood that the first left-hand master manipulator and the first right master manipulator may have similar structures. The structure of the first master manipulator is described below using the first left-hand master manipulator as an example.
[0048] FIG4 shows a schematic diagram of the structure of the first left-hand master manipulator 400 of some embodiments of the present disclosure. The definitions of the coordinate systems in FIG4 are as follows: the master manipulator base coordinate system {M} of the first left-hand master manipulator, with its origin at the base of the manipulator arm and vertically upwards direction, The direction is shown in Figure 4, Figure 10A or Figure 10B. The handle coordinate system {H} of the first left-hand master manipulator has its origin at the end of the manipulator or on the handle. The direction of the axis of the end or the handle is consistent. The reference coordinate system {w} can be the coordinate system of the space where the first left-hand master manipulator is located, such as the master manipulator base coordinate system {M}, or the world coordinate system, as shown in FIG4. In some embodiments, the body feeling of the first operator can be used as a reference. When the first operator sits in front of the first master control trolley, the body feeling upward is Direction, the forward direction of the body is It will be appreciated that for clarity, the handle coordinate system {H} and the handle 402 are shown as separate in FIG4 , but they are coincident.
[0049] As shown in FIG4 , the first left-hand master manipulator 400 may include a robotic arm 401 having multiple degrees of freedom and a handle 402 disposed on the robotic arm 401. The robotic arm 401 includes at least one attitude joint and at least one position joint. The attitude joint is used to control the attitude of the handle 402 of the first left-hand master manipulator 400, and the handle 402 is controlled to achieve a desired attitude through one or more attitude joints. The position joint is used to control the position of the handle 402 of the first left-hand master manipulator 400, and the handle 402 is controlled to achieve a desired position through one or more position joints. For example, the first left-hand master manipulator 400 may include seven joints distributed sequentially from the distal end to the proximal end. The distal end of the first left-hand master manipulator 400 may be the end close to the master control trolley (e.g., the end connected to the master control trolley), and the proximal end of the first left-hand master manipulator 400 may be the end away from the master control trolley (e.g., the end where the handle 402 is disposed). Among them, joints 1, 2, 5, 6, and 7 are posture joints used to adjust the posture of the handle 402 of the first left-hand master manipulator 400. Joints 1, 2, and 3 are position joints used to adjust the position of the handle 402 of the first left-hand master manipulator 400. Joint 4 can be a slave joint of joint 3. Joints 1 and 2 can be composite joints that can be used to adjust the position and posture of the handle 402 of the first left-hand master manipulator 400. In some embodiments, the handle 402 can also include a clamp 4012, which can be used to control the opening and closing angle of the driven instrument of at least one driven tool.
[0050] It should be understood that the second master control trolley can have a similar structure to the first master control trolley, and the second left-hand master operator and the second right-hand master operator carried on the second master control trolley can have similar structures to the first left-hand master operator and the first right-hand master operator. It should be understood that the structures of the master control trolley and the master operator are not limited to the above. As long as the master control trolley and the master operator can realize the remote control of the slave tool to perform an operation, they do not depart from the scope of this disclosure.
[0051] In some embodiments, as shown in FIG2 , a surgical robotic system 200 may include multiple surgical trolleys as surgical modules. In some embodiments, the multiple surgical trolleys may include a first surgical trolley 230 and a second surgical trolley 240. The first surgical trolley 230 may be used to carry multiple slave tools 231, such as three slave tools (e.g., the first slave tool 530, the second slave tool 540, and the third slave tool 550 shown in FIG5A and FIG5C ), and the second surgical trolley 240 may be used to carry a fourth slave tool 241.
[0052] In some embodiments, the first operating trolley 230 can be the main trolley in the surgical robot system 200, equipped with multiple slave tools to perform surgical operations. Figure 5A shows a schematic diagram of the first operating trolley 500 in some embodiments of the present disclosure, Figure 5B shows a structural schematic diagram of the RCM mechanism mounted on the first operating trolley 500 according to some embodiments of the present disclosure, and Figure 5C shows a schematic diagram of the first operating trolley 500' according to other embodiments of the present disclosure. In some embodiments, as shown in Figures 5A and 5C, the first operating trolley 500 or the first operating trolley 500' may include a first trolley body 510 and a first motion arm 520 for carrying multiple slave tools and / or slave vision devices. In the following, the first operating trolley 500 or the first operating trolley 500' is configured to carry a first slave tool 530, a second slave tool 540, a third slave tool 550 and a slave vision device 560 as an example for explanation.
[0053] In some embodiments, as shown in Figures 5A and 5C, the first trolley body 510 may include a base 511, a column 512 extending vertically from the base 511, and a crossbeam 513 mounted on top of the column 512. The crossbeam 513 may extend horizontally from the top of the column 512 perpendicular to the height direction of the base 511, and a first moving arm 520 for carrying multiple driven tools may be rotatably provided at the end of the crossbeam 513.
[0054] In some embodiments, the proximal end of the first motion arm 520 is configured to be rotationally coupled to the first trolley body 510, and the distal end is configured to carry at least a first slave tool 530, a second slave tool 540, a third slave tool 550, and a slave vision device 560. The first motion arm 520 comprises a motion arm having multiple degrees of freedom and comprised of multiple joints. In some embodiments, as shown in Figures 5A and 5B, the first motion arm 520 may include a positioning linkage mechanism 521 and a remote center of motion (RCM) mechanism 522.
[0055] In some embodiments, the proximal end of the positioning linkage mechanism 521 is rotationally connected to the first trolley body, for example, at the proximal end (e.g., the end near the first surgical trolley 500) it is connected to the crossbeam 513 via a joint, as shown in FIG5A . As shown in FIG5B , the positioning linkage mechanism 521 may include a first link 5211 and a first rotary joint. The proximal end of the first link 5211 is rotationally connected to the end of the crossbeam 513 via the first rotary joint, so that the first link 5211 rotates relative to the pan / tilt head 513 about the rotation axis of the first rotary joint (e.g., an axis perpendicular to the horizontal plane). As shown in FIG5B , the first motion arm 520 may also include a second link 5212 and a second rotary joint. The proximal end of the second link 5212 is rotationally connected to the distal end of the first link 5211 via the second rotary joint, so that the second link 5212 rotates relative to the first link 5211 about the longitudinal axis. It should be understood that the positioning linkage mechanism is not limited to the above structure. For example, the positioning linkage mechanism may also include a third link and a third rotary joint to further increase the motion capability of the positioning linkage mechanism. In some embodiments, each joint of the positioning link mechanism 521 may include a motor, which drives the corresponding joint to rotate under the control of a control device (not shown in the figure), so that the positioning link mechanism 521 moves in space to form a desired configuration, thereby driving the RCM mechanism 522 to move in space. By arranging multiple connecting rods horizontally and partially overlapping them in a folded manner, the lateral space occupied by the first moving arm 520 can be reduced, the horizontal space in the operating room can be fully utilized, and the space occupied by the operating trolley on the side of the bed can be reduced. Providing two or more rotating joints in the horizontal direction can reduce the swing interference of the positioning link mechanism 521 of the first moving arm 520 in the horizontal plane, increase its movement space, and improve the flexibility of the first moving arm 520.
[0056] In some embodiments, the RCM mechanism 522 can be configured so that the proximal end can rotate relative to the distal end of the positioning link mechanism 521. For example, the RCM mechanism 522 can be configured so that the proximal end is rotationally connected to the distal end of the positioning link mechanism 521 (for example, the distal end of the second link 5212), or configured so that the proximal end is rotationally connected to the distal end of the vertical arm lifting mechanism 523 provided at the distal end of the positioning link mechanism 521, and the specific content will be described later. In the present disclosure, the RCM can be an entry point or an incision position, and the RCM mechanism can be configured to move the surgical tools or the slave visual equipment carried on the first operating trolley around the RCM to adjust the position or surgical operation. The RCM mechanism may include a plurality of arcuate arms, such as a first arcuate arm 5221, a second arcuate arm 5222 and a third arcuate arm 5223, as shown in Figure 5B. The proximal ends and distal ends of the plurality of arcuate arms are rotationally connected in sequence, and the rotation axes of the plurality of arcuate arms intersect at the RCM. In some embodiments, each joint of the RCM mechanism 522 may include a motor, which drives the corresponding joint to rotate under the control of a control device (not shown in the figure), so that the first arc arm 5221, the second arc arm 5222 and the third arc arm 5223 can move in coordination or independently, thereby allowing the RCM mechanism 522 to move arbitrarily in space to form a desired configuration while keeping the RCM stationary. For example, it can be converted between multiple configurations of fully folded, fully unfolded and partially unfolded to drive multiple slave tools or slave visual devices to rotate around the RCM.
[0057] In some embodiments, as shown in Figures 5A and 5B, the first motion arm 520 may further include a vertical arm lifting mechanism 523, configured such that a proximal end is connected to a distal end of the positioning linkage mechanism 521, such as the distal end of the second link 5212, and a distal end is connected to a proximal end of the RCM mechanism 522, such as the proximal end of the first arcuate arm 5221. The vertical arm lifting mechanism 523 may include a vertical arm and a vertical arm lifting joint serving as a linear motion joint. By driving the vertical arm lifting joint, the vertical arm may be raised or lowered relative to the positioning linkage mechanism 521, thereby driving the RCM mechanism 522 and the mounting platform 527 disposed at the distal end of the vertical arm to rise or fall relative to the positioning linkage mechanism 521. In some embodiments, the vertical arm lifting mechanism 523 may further include a rotational motion joint to allow the RCM mechanism 522 and the mounting platform 527 to rotate relative to the distal end of the positioning linkage mechanism 521 about a longitudinal axis. It should be understood that the first moving arm 520 can also omit the vertical arm lifting mechanism 523, and the RCM mechanism is directly rotationally connected to the distal end of the positioning link mechanism 521, such as the distal end of the second link 5212.
[0058] In some embodiments, as shown in FIG5C , the first operating trolley 500′ can also be configured to adjust the overall height of the first operating trolley 500′ by raising and lowering the column 512 of the first trolley body 510. In some embodiments, the column 512 can include a column lifting joint (not shown) serving as a linear motion joint. By driving the column lifting joint, the column 512 can be raised and lowered relative to the base 511, thereby driving the crossbeam 513 disposed at the top of the column 512, the first motion arm 520 connected to the distal end of the crossbeam 513, and the multiple slave tools or slave vision devices carried on the first motion arm 520 to rise and fall as a whole. By providing a liftable column on the first trolley body, the vertical space occupied by the first operating trolley can be reduced. Furthermore, since there is no need to provide an additional lifting mechanism on the first moving arm (such as the vertical arm lifting mechanism 523 provided between the RCM mechanism 522 and the mounting platform 527 as shown in FIG. 5A and FIG. 5B ), the structure of the first moving arm can be simplified, thereby avoiding the first moving arm from having insufficient stability during movement due to an overly long motion chain or too many joints, such as shaking.
[0059] In some embodiments, the first moving arm 520 may further include a mounting platform 527. The mounting platform 527 is fixedly disposed at the distal end of the RCM mechanism 522. For example, as shown in FIG5B , the mounting platform 527 may be fixedly disposed at an arcuate arm located on a side away from the positioning link mechanism 521 among the multiple arcuate arms of the RCM mechanism 522, such as the distal end of the third arcuate arm 5223. The mounting platform 527 may include multiple mounting positions, such as four mounting positions. In some embodiments, as shown in FIG5B , the first moving arm 520 may further include multiple linear modules 528, and the multiple linear modules 528 are respectively disposed at multiple mounting positions. The linear modules 528 may respectively include a linear module motor, a screw rod, a slide rail, and a slider. The slider is slidably connected to the screw rod and slidably disposed on the slide rail. The screw rod is coupled to the output end of the linear module motor and drives the slider to slide along the slide rail under the drive of the linear module motor. In some embodiments, as shown in FIG5B , the first motion arm 520 may further include multiple drive devices 529 for carrying and driving multiple surgical tools or slave vision devices, such as a first slave tool, a second slave tool, a third slave tool, and a slave vision device. The multiple drive devices 529 are mounted on the multiple linear modules 528, respectively, to drive the multiple linear modules 528 for linear motion. For example, the multiple drive devices 529 may be fixedly mounted on the sliders of the multiple linear modules 528. Driven by the linear module motors, the lead screws of the linear modules 528 drive the sliders along the slide rails, thereby driving the drive devices 529 fixedly connected to the sliders for linear motion. Before the surgical procedure, the multiple slave tools and / or slave vision devices may be arranged in a predetermined distribution on the mounting platform 527. The predetermined distribution of the multiple slave tools on the mounting platform can be predetermined based on the surgical procedure and stored in the memory of the surgical robot system. It should be understood that the multiple drive devices on the first slave trolley 500 may have a universal drive interface, so that the multiple slave tools can be interchangeably mounted on the mounting platform 527. In some embodiments, multiple slave tools and / or slave vision devices can be installed on the mounting platform 527 in an arbitrary distribution. The control device can be configured to detect the type of slave tools and / or slave vision devices installed in each mounting position on the mounting platform 527 in response to the slave tools and / or slave vision devices being installed in place, and generate a distribution status of multiple slave tools and / or slave vision devices on the mounting platform 527.
[0060] In some embodiments, as shown in FIG5A , the plurality of slave tools may include a first slave tool 530, a second slave tool 540, and a third slave tool 550. The slave vision device may include a slave vision device 560. The first slave tool 530 may include a first tool arm 531 and a first slave instrument 532 disposed at the end of the first tool arm 531, the second slave tool 540 may include a second tool arm 541 and a second slave instrument 542 disposed at the end of the second tool arm 541, and the third slave tool 550 may include a third tool arm 551 and a third slave instrument 552 disposed at the end of the third tool arm 551. The slave vision device 560 may include an imaging tool arm 561 and an endoscope 562 disposed at the end of the imaging tool arm 561. In some embodiments, at least a portion of the first tool arm 531 and the first slave instrument 532, at least a portion of the second tool arm 541 and the second slave instrument 542, at least a portion of the third tool arm 551 and the third slave instrument 552, at least a portion of the imaging tool arm 561 and the endoscope 562 are configured to be able to enter the operating area through a surgical connection device 570 (e.g., a sheath), as shown in the enlarged area in Figure 5A. In some embodiments, the slave tool and / or the slave vision device may further include a drive transmission device. In some embodiments, the drive transmission device can cooperate with the drive device to drive the tool arm to move. The drive transmission device is used to connect to the drive device, and the driving force of the drive device is transmitted to the tool arm of each slave tool or the imaging tool arm of the slave vision device via the drive transmission device, thereby driving the tool arm or the imaging tool arm to achieve multi-degree-of-freedom movement. The drive device can also control the slave instrument of the slave tool to perform the surgical operation.
[0061] In some embodiments, the plurality of drive devices may include at least a first drive device, a second drive device, a third drive device, and a fourth drive device, respectively driving a first driven tool, a second driven tool, a third driven tool, and a driven visual device. In some embodiments, the plurality of linear modules 528 may include a first linear module, a second linear module, a third linear module, and a fourth linear module, respectively carrying the first, second, third, and fourth drive devices of the plurality of drive devices. In some embodiments, the plurality of mounting locations of the mounting platform 527 may include a first mounting location, a second mounting location, a third mounting location, and a fourth mounting location spaced around the center of the mounting platform 527, respectively mounting the first, second, third, and fourth linear modules of the plurality of linear modules 528. Furthermore, the mounting platform 527 may be configured such that the axes of the plurality of mounting locations are oriented toward the RCM, such that when mounted on the mounting platform 527, the distal extensions of the first, second, third, and fourth linear modules converge toward the RCM. Therefore, when multiple linear modules are installed on the mounting platform, the proximal ends diverge away from each other, and the extended lines of the distal ends converge toward the remote motion center. This allows the drive device to carry driven tools and / or driven visual equipment without interfering with each other when moving along the linear modules, thereby ensuring the safety of operation.
[0062] In some embodiments, the second operating trolley 240 can be a secondary trolley in the surgical robot system 200, used to assist the first operating trolley (for example, the first operating trolley 130 shown in FIG. 1B , the first operating trolley 230 shown in FIG. 2 , the first operating trolley 500 shown in FIG. 5A , the first operating trolley 500′ shown in FIG. 5C , or the first operating trolley 1010 shown in FIG. 10A ) in performing surgical operations. In some embodiments, the second operating trolley can carry slave tools for laparoscopic surgery, or can carry slave tools from other departments to achieve cross-departmental surgical operations. For example, when carried on the second operating trolley, the fourth slave tool can include at least one of a laparoscopic system surgical tool, an orthopedic surgical tool, a neurosurgery surgical tool, a puncture surgical tool, an interventional surgical tool, and a transurethral bladder surgical tool.
[0063] FIG6 shows a schematic diagram of a second operating trolley 600 in some embodiments of the present disclosure. In some embodiments, as shown in FIG6 , the second operating trolley 600 can be a single-arm operating trolley. The second operating trolley 600 can include a second trolley body 610, a second motion arm 620, and a fourth slave tool 630. It should be understood that the second operating trolley 600 can also be configured to include a slave vision device (not shown) in place of the fourth slave tool. The following description will be based on an example of a second operating trolley equipped with a fourth slave tool.
[0064] The second motion arm 620 may include a motion arm with multiple degrees of freedom composed of multiple joints. In some embodiments, the second motion arm 620 may be connected to the second trolley body 610 via a joint at its proximal end (e.g., the end close to the second surgical trolley 600), and used to carry at least a fourth slave tool 630 or a slave visual device at its distal end (e.g., the end away from the second surgical trolley 600). As shown in Figure 6, the second motion arm 620 may include a vertical arm 621 and at least one swing arm connected in sequence. The proximal end of the vertical arm 621 may be fixed to the second trolley body 610, or the vertical arm 621 may be rotatably connected to the second trolley body 610 so that the vertical arm 621 rotates relative to the second trolley body 610 about an axis perpendicular to the horizontal plane. The at least one swing arm may be configured such that its proximal end is rotatably connected to the distal end of the vertical arm 621 so as to rotate relative to the vertical arm 621 about a horizontal axis, and the proximal end of the at least one swing arm is used to carry the fourth slave tool 630. For example, as shown in FIG6 , the plurality of swing arms may include a first swing arm 622, a second swing arm 623, and a third swing arm 624, each of which is rotatably connected at its proximal and distal ends, respectively. The proximal end of the first swing arm 622 is rotatably connected to the distal end of the vertical arm 621 so as to rotate about a horizontal axis relative to the vertical arm 621. The proximal end of the second swing arm 623 is rotatably connected to the distal end of the first swing arm 622. The proximal end of the third swing arm 624 is rotatably connected to the distal end of the second swing arm 623. In some embodiments, a mounting position may be formed at the end of the third swing arm 624. The second motion arm 620 may further include a fourth drive device (not shown) disposed at the mounting position for carrying and driving a fourth driven tool 630. In some embodiments, the fourth driven tool 630 may have a structure similar to the first to third driven tools (e.g., the first driven tool 530, the second driven tool 540, and the third driven tool 550 shown in FIG5A ). The fourth slave tool 630 may include a fourth tool arm 631 and a fourth slave instrument 632 disposed at the end of the fourth tool arm 631. The distal end of the fourth tool arm 631 and the fourth slave instrument 632 are configured to be able to enter the operating area through an opening formed on the patient's body through a tube sleeve, a sheath sleeve, etc. In some embodiments, the fourth slave tool 630 may also include a drive transmission device. The drive transmission device is used to connect to the drive device to transmit the driving force of the drive device to the fourth tool arm 631, thereby driving the fourth tool arm 631 to achieve multi-degree-of-freedom movement. The drive device can also control the fourth slave instrument 632 to perform surgical operations. It should be understood that the fourth slave tool 630 can also be other types of surgical tools suitable for cross-departmental surgical operations, such as straight-rod surgical tools such as puncture surgical tools.
[0065] FIG7 illustrates a schematic diagram of a slave vision device 750 observing an operating area in accordance with some embodiments of the present disclosure. In some embodiments, as shown in FIG7 , the slave vision device 750's field of view may include at least a portion of the first slave tool 710, the second slave tool 720, the third slave tool 730, and the fourth slave tool 740 located within the operating area. The slave vision device 750 may be configured to provide an image of the operating area to the first operator and / or the second operator, allowing the first operator and / or the second operator to intuitively operate the slave tool through the master operator to perform the surgical procedure while maintaining a visual field of the operating area where the slave tool is located.
[0066] In some embodiments, the slave vision device 750 can be fixed in position or variable in position. For example, the slave vision device 750 can maintain a specific posture after being inserted into the patient's body through a tube sleeve, sheath sleeve, etc. to provide an image of the operation area, or the slave vision device 750 can adjust its position or posture under remote operation of the first operator and / or the second operator to meet the field of view requirements of the first operator and / or the second operator.
[0067] In some embodiments, the surgical robot system 200 may further include an equipment trolley 260 as an auxiliary module. FIG8 shows a schematic diagram of an equipment trolley 800 according to some embodiments of the present disclosure. In some embodiments, as shown in FIG8 , the equipment trolley 800 may include a trolley body 810 and a display device 820. In some embodiments, the trolley body 810 may include a base 811 and a bracket 812. The bracket 812 may be, for example, a movable bracket with adjustable posture. The proximal end of the bracket 812 is disposed on top of the base 811, and the distal end is used to mount the display device 820. The display device 820 may include at least one display. The display may be configured to display intraoperative images captured by a slave visual device (e.g., the slave visual device 141 shown in FIG1B , the slave visual device 234 shown in FIG2 , the slave visual device 750 shown in FIG7 , or the slave visual device 1160 shown in FIG11 ). In some embodiments, at least one display may further include a touch screen configured to display a user interface for displaying reminder information or receiving input commands, etc., to enable human-computer interaction with the operator. In some embodiments, the equipment trolley 800 can also be used to place equipment required for various surgical procedures, such as slave tools (for example, the first slave tool 131, the second slave tool 132, the third slave tool 133, the fourth slave tool 134, etc. shown in Figure 1A or Figure 1B) or slave vision devices (for example, the slave vision device 141 shown in Figure 1B, the slave vision device 234 shown in Figure 2, the slave vision device 750 shown in Figure 7, or the slave vision device 1160 shown in Figure 11), etc., which are installed on the surgical trolley.
[0068] In some embodiments, as shown in FIG8 , the equipment trolley 800 may further include at least one positioning sensing unit 830. The positioning sensing unit 830 may be communicatively connected to a control device (e.g., the control device 150 shown in FIG1A or FIG1B ) and configured to locate objects within the operating room through signal sensing and / or image acquisition. The positioning sensing unit may include at least one of an acoustic wave detection unit, a magnetic field detection unit, and an optical signal detection unit.
[0069] For example, the positioning sensing unit may include at least one image acquisition device for acquiring a positioning image of the mobile station. The image acquisition device may include, but is not limited to, a dual-lens image acquisition device or a single-lens image acquisition device, such as a monocular camera, a binocular camera, a monocular structured light camera, a binocular structured light camera, a TOF (Time of Flight) camera, etc. Depending on the application environment, the image acquisition device may be a camera, an industrial camera, etc. In some embodiments, the image acquisition device may implement at least one of visible light imaging and infrared imaging. Depending on the type of image being acquired, those skilled in the art may select different image acquisition devices as the image acquisition device. In some embodiments, the equipment trolley 800 may include three positioning sensing units 830 for respectively locating a first operating trolley (e.g., the first operating trolley 130 shown in FIG. 1B , the first operating trolley 230 shown in FIG. 2 , the first operating trolley 500 shown in FIG. 5A , the first operating trolley 500′ shown in FIG. 5C , or the first operating trolley 1010 shown in FIG. 10A ), a second operating trolley (e.g., the second operating trolley 140 shown in FIG. 1B , the second operating trolley 240 shown in FIG. 2 , the second operating trolley 600 shown in FIG. 6 , or the second operating trolley 1020 shown in FIG. 10A ), and an operating table (e.g., the operating table 280 shown in FIG. 2 ), or a surgical connection device on the operating table (e.g., the surgical connection device 270 shown in FIG. 2 , or the surgical connection device 570 shown in FIG. 5A and FIG. 5C ). The details will be described later. Those skilled in the art will appreciate that the positioning sensing unit is not limited to being provided on the equipment trolley. The positioning sensing unit may also be integrated into a control trolley or surgical trolley (e.g., positioning sensing unit 830 shown in FIG8 ), or may be independently provided (e.g., positioning sensing unit 1030 shown in FIG10B ). In some embodiments, the positioning sensing unit may also be located outside the surgical robotic system, such as in an operating room environment.
[0070] Those skilled in the art should understand that the surgical robot system is not limited to the above structure and can be actually combined according to the needs of the surgery. In some embodiments, the second operating trolley of the surgical robot can be a visual trolley, which is only used to carry a slave visual device, and a plurality of slave tools can be carried on the first operating trolley to perform surgical operations under the control of the first operator and the second operator. For example, the first operating trolley can be equipped with a plurality of slave tools, such as the first to fourth slave tools, and the second operating trolley can be equipped with a slave visual device. Alternatively, the first operating trolley can be equipped with the first to third slave tools and the slave visual device, and the second operating trolley can be equipped with a fourth slave tool, such as a slave tool from another department, to achieve cross-departmental surgical operations.
[0071] In some embodiments, the first and second operating trolleys can also include a total of five or more slave tools to support complex surgical procedures. For example, the first operating trolley can carry a fifth slave tool in addition to the first through third slave tools. Alternatively, the second operating trolley can be similar to the first operating trolley and can carry both a fourth slave tool and a fifth slave tool, or both a fourth slave tool and a slave vision device.
[0072] In the present disclosure, the surgical robot system further includes a control device (e.g., control device 150 shown in FIG. 1A or FIG. 1B ), configured to control the movement of a slave instrument of at least one of a plurality of slave tools based on the movement of a handle of at least one of a plurality of master manipulators to perform a surgical operation. Those skilled in the art will appreciate that the control device may be integrated into at least one of a master control trolley, an operating trolley, or an equipment trolley of the surgical robot system, or may be located outside the surgical robot system.
[0073] In the present disclosure, a plurality of slave tools and a slave visual device can be assigned to a first operator who controls a first left-hand master manipulator and a first right-hand master manipulator and a second operator who controls a second left-hand master manipulator and a second right-hand master manipulator as required. In some embodiments, a first slave tool among a plurality of slave tools can be assigned to a first left-hand master manipulator or a first right-hand master manipulator, a second slave tool can be assigned to a second left-hand master manipulator or a second right-hand master manipulator, and a third slave tool and a fourth slave tool are placed in an unassigned state. Alternatively, a first surgical tool and a second surgical tool among a plurality of slave tools can be assigned to a first left-hand master manipulator or a first right-hand master manipulator, respectively, a third slave tool can be assigned to a second left-hand master manipulator or a second right-hand master manipulator, and a fourth slave tool is placed in an unassigned state. Alternatively, a first slave tool, a second slave tool, a third slave tool and a fourth slave tool among a plurality of slave tools can be assigned to a first left-hand master manipulator, a first right-hand master manipulator, a second left-hand master manipulator and a second right-hand master manipulator, respectively, as shown in FIG. 9 or FIG. 11 . Those skilled in the art will appreciate that there are various ways to allocate the multiple slave tools in a surgical robot system to meet different surgical operation requirements. Those skilled in the art will also appreciate that the number of master manipulators and slave tools is not limited to the number described above, and the number of master manipulators and slave tools may also be inconsistent. The number of master manipulators and slave tools in a surgical robot system can be adjusted based on actual needs.
[0074] Before or during a surgical procedure, the first, second, third, and fourth slave tools are assigned to the first left-hand master manipulator, the first right-hand master manipulator, the second left-hand master manipulator, and the second right-hand master manipulator, respectively. This establishes an association between the multiple master manipulators and the multiple slave tools, allowing the surgical functions of the slave tools to be assigned to the corresponding master manipulators. By establishing a master-slave mapping between the assigned master manipulators and slave tools, multiple slave tools can be used to perform surgical operations simultaneously under the master-slave teleoperation control of the first and second operators.
[0075] Figure 9 shows a schematic diagram of the allocation status of the slave tools of some embodiments of the present disclosure. In some embodiments, the control device can be configured to allocate the first slave tool, the second slave tool, the third slave tool and the fourth slave tool to the first left-hand master operator, the first right-hand master operator, the second left-hand master operator and the second right-hand master operator, respectively, in response to a pre-set or allocation request. In some embodiments, as shown in Figure 9, the control device can be configured to allocate the first slave tool 931, the second slave tool 932, the third slave tool 933 and the fourth slave tool 941 to the first left-hand master operator 911a, the first right-hand master operator 911b, the second left-hand master operator 921a and the second right-hand master operator 912d, respectively (the allocation status of at least one master operator and at least one slave tool is shown by solid arrows in the figure).
[0076] In some embodiments, the pre-settings may include multiple tool allocation modes corresponding to the surgical procedure, so as to allow the control device to automatically allocate at least one of the multiple slave tools to at least one of the multiple master manipulators. The tool allocation mode, for example, includes an allocation relationship between at least one of the multiple slave tools and at least one of the multiple master manipulators. For example, the first slave tool, the second slave tool, the third slave tool, and the fourth slave tool may be allocated one-to-one to the first left-hand master manipulator, the first right-hand master manipulator, the second left-hand master manipulator, and the second right-hand master manipulator. Alternatively, when the number of slave tools is greater than the number of master manipulators, the tool allocation mode may also include allocating multiple slave tools (e.g., two slave tools) to one master manipulator, and allocating other slave tools in the multiple slave tools to other master manipulators in the multiple master manipulators one-to-one, so as to allow the operator to quickly switch between multiple slave tools associated with one master manipulator. For example, during the operation, the operator can quickly switch between slave tools by stepping on a switching pedal on a master control trolley (e.g., the first master control trolley 300 shown in FIG3 ). Alternatively, in the case where the number of slave tools is greater than the number of master operators, the tool allocation mode may also include allocating slave tools corresponding to the number of master operators among the multiple slave tools to multiple master operators one by one, and placing other slave tools in an unallocated state to allow the first operator or the second operator to issue an allocation request for the unallocated slave tools during the operation.
[0077] In some embodiments, the tool allocation mode can be pre-set based on various surgical procedures and stored in the memory of the surgical robot system. Before the surgical operation, the control device can allocate at least one of the multiple slave tools to at least one master operator among the multiple master operators based on the tool allocation mode corresponding to the current surgical procedure. In some embodiments, the tool allocation mode can also be pre-set based on the operator's operating habits and stored in the memory of the surgical robot system in association with the operator's identity. Before the surgical operation, the control device can select the corresponding tool allocation mode based on the operator's identity and the current surgical procedure, and allocate at least one of the multiple slave tools to at least one master operator among the multiple master operators. It should be understood that the control device can perform the pre-allocation of the multiple slave tools before or after the multiple slave tools are installed. For example, the control device may be configured to pre-assign the multiple slave tools to the multiple master manipulators before the multiple slave tools are mounted on the surgical trolley based on a predetermined distribution of the multiple slave tools on a motion arm (e.g., the first surgical robot 500 shown in FIG. 5A or the first motion arm 520 of the first surgical trolley 500' shown in FIG. 5C) and a tool allocation pattern corresponding to the current surgical procedure. Alternatively, the control device may be configured to pre-assign the multiple slave tools to the multiple master manipulators after the multiple slave tools are mounted on the surgical trolley based on a distribution state of the multiple slave tools on a motion arm (e.g., the first surgical robot 500 shown in FIG. 5A or the first motion arm 520 of the first surgical trolley 500' shown in FIG. 5C) and a tool allocation pattern corresponding to the current surgical procedure.
[0078] In some embodiments, the allocation request may include a pre-operative allocation request and an intra-operative allocation request. The pre-operative allocation request may be a tool allocation request input by the first operator and / or the second operator before the surgical operation to pre-allocate the first to fourth slave tools to the first left-hand master operator, the first right-hand master operator, the second left-hand master operator, and the second right-hand master operator. The intra-operative allocation request may be a tool allocation request input by the first operator and / or the second operator during the surgical operation to allocate at least one of the first to fourth slave tools to at least one of the first left-hand master operator, the first right-hand master operator, the second left-hand master operator, and the second right-hand master operator.
[0079] In some embodiments, the control device can be configured to determine whether the at least one slave tool and / or at least one master operator involved in the allocation request meets the allocation conditions based on the allocation request. In some embodiments, the allocation conditions include that at least one slave tool is not allocated and / or at least one master operator has a higher allocation priority. Those skilled in the art will understand that during a collaborative operation between a first operator and a second operator, the first operator may be, for example, a primary surgeon who remotely operates the slave tool on the first master control trolley to perform the main surgical operation during the operation, and the second operator may be, for example, an assistant surgeon who remotely operates the slave tool on the second master control trolley to perform secondary surgical operations to assist the primary surgeon. Therefore, the operating needs and field of view needs of the primary surgeon need to be met first during the operation. In the present disclosure, the allocation priority of the master operator means that among the multiple primary operators of the surgical robot system, the primary operator operated by an operator with a high priority has a higher allocation priority. In some embodiments, as shown in FIG9 , among the multiple master operators, the first left-hand master operator 911a and the first right-hand master operator 911b may have a higher allocation priority than the second left-hand master operator 921a and the second right-hand master operator 921b, thereby ensuring that the allocation request of the first operator, who is the primary surgeon, is preferentially satisfied. In some embodiments, the first left-hand master operator 911a and the first right-hand master operator 911b may have the same higher allocation priority, and the second left-hand master operator 921a and the second right-hand master operator 921b may have the same lower allocation priority.
[0080] In some embodiments, the control device may also be configured to assign the slave instrument of at least one slave tool to the handle of at least one master operator in response to the allocation condition being met. In some embodiments, the control device may be configured to assign the slave instrument of at least one slave tool to the handle of the corresponding at least one master operator in response to the at least one slave tool involved in the allocation request being in an unassigned state. For example, as shown by the hollow arrow in Figure 9, the control device may be configured to release the allocation relationship between the second right-hand master operator 921b and the fourth slave tool 941 (or disconnect the master-slave mapping) in response to the second operator issuing an allocation request to assign the fifth slave tool 951 in an unassigned state to the second right-hand master operator 921b, and assign the fifth slave tool 951 to the second right-hand master operator 921b.
[0081] Before or during a surgical operation, an operator may issue an allocation request to at least one slave tool that has been assigned to at least one master operator. In some embodiments, the control device may be configured to reallocate the slave tool assigned to the master operator with a lower or same priority to the master operator with a higher or same priority in response to an allocation request from a master operator with a higher or same priority to a slave tool assigned to a master operator with a lower or same priority. For example, the control device may be configured to prompt the second operator when a first operator, acting as the primary surgeon, issues an allocation request to at least one slave tool assigned to a second operator, acting as the secondary surgeon, and to assign the slave tool to the master operator operated by the first operator. As shown by the dotted arrow in FIG9 , the control device may be configured to, when the first operator issues an allocation request to assign the third slave tool 933 assigned to the second left-hand master operator 921a operated by the second operator to the first left-hand master operator 911a, release the allocation relationship between the second left-hand master operator 921a and the third slave tool 933 (or disconnect the master-slave mapping) and assign the third slave tool 933 to the first left-hand master operator 911a. Alternatively, the control device may be configured to, when the first operator or the second operator issues an assignment request to interchange the slave tool assigned to the left-hand master operator operated by the first operator and the slave tool assigned to the right-hand master operator, swap the two slave tools and assign them to the corresponding master operators. For example, as shown by the dotted arrow in FIG9 , when the second operator issues an assignment request to interchange the third slave tool 933 assigned to the second left-hand master operator 921a and the fourth slave tool 941 assigned to the second right-hand master operator 921b, the control device may be configured to cancel the assignment relationship (or disconnect the master-slave mapping) between the second left-hand master operator 921a and the third slave tool 933, and the assignment relationship (or disconnect the master-slave mapping) between the second right-hand master operator 921b and the fourth slave tool 941, and assign the third slave tool 933 and the fourth slave tool 941 to the second right-hand master operator 921b and the second left-hand master operator 921a, respectively. In some embodiments, the control device may be configured to, in response to a master operator with a lower priority request for an assignment of a slave tool assigned to a master operator with a higher priority, reassign the slave tool assigned to the master operator with a higher priority to the master operator with a lower priority, based on the assignment approval. For example, when a second operator, acting as an assisting surgeon, issues an assignment request for at least one slave tool assigned to a first operator, acting as a primary surgeon, the control device may be configured to send a request message to the first operator, and when the first operator approves the assignment request, assign the slave tool to the master operator operated by the second operator.As shown by the double-dotted arrow in Figure 9, the control device can be configured to send a request message to the first operator when the second operator issues an allocation request to assign the second slave tool 932 assigned to the first right-hand master operator 911b operated by the first operator to the second left-hand master operator 921a, and when the first operator approves the allocation request, release the allocation relationship between the first right-hand master operator 911b and the second slave tool 932 (or disconnect the master-slave mapping), and assign the second slave tool 932 to the second left-hand master operator 921a.
[0082] During the surgical operation, the operator controls the position and posture of the slave instrument of at least one slave tool by remotely operating the handle of at least one master manipulator. During the start-up of the remote operation, if the posture (such as orientation or angle) of the handle of the master manipulator does not match the posture (such as orientation or angle) of the slave instrument of the slave tool, it will make it difficult for the operator to experience an intuitive sense of operation, and reduce the operator's control accuracy over the slave tool. Therefore, in some embodiments, the control device can be configured to control at least one master manipulator to match at least one slave tool having an assigned relationship after assigning at least one slave tool among a plurality of slave tools to at least one master manipulator among a plurality of master manipulators and before establishing a master-slave mapping between at least one master manipulator and at least one slave tool. In the present disclosure, the matching of the handle of at least one master manipulator with the slave instrument of at least one slave tool can include matching the posture of the handle of at least one master manipulator with the posture of the slave instrument of at least one slave tool. In some embodiments, in order to make the posture changes felt by the operator through remote operation of the handle of at least one master manipulator consistent with the posture changes of the slave instrument of at least one slave tool perceived by the operator in the display, the matching of the handle of at least one master manipulator with the slave instrument of at least one slave tool can include the posture of the handle of at least one master manipulator relative to the reference coordinate system being consistent with the posture of the image of the slave instrument of at least one slave tool in the display relative to the reference coordinate system.
[0083] In some embodiments, the control device can be configured to obtain the initial posture of the slave instrument of at least one slave tool; obtain the initial posture of the handle of at least one master manipulator that has an assigned relationship with the slave instrument of at least one slave tool; based on the initial posture of the handle of at least one master manipulator and the initial posture of the slave instrument of at least one slave tool, determine whether the handle of at least one master manipulator matches the slave instrument of at least one slave tool; and in response to the handle of at least one master manipulator not matching the slave instrument of at least one slave tool, generate a master manipulator control signal, the master manipulator control signal being used to adjust the posture of the handle of at least one master manipulator to match the posture of the slave instrument of at least one slave tool.
[0084] In some embodiments, the control device can be configured to control at least one master operator to match at least one slave tool having an assigned relationship in response to detecting a matching trigger. In some embodiments, the matching trigger may include operating a trigger device provided on the master operator or the master control trolley. The operation of the trigger device may be, for example, toggling a switch on the master operator, touching a sensing position on the master operator, long pressing or tapping a button on the master operator, stepping on a pedal of the master control trolley, operating a display screen of the master control trolley, etc. It should be understood that the matching trigger can be pre-set and stored in the memory of the surgical robot system. In some embodiments, the control device can also be configured to automatically control at least one master operator to match at least one slave tool having an assigned relationship after assigning at least one of the multiple slave tools to at least one of the multiple master operators.
[0085] FIG10A is a schematic diagram of coordinate systems in remote teleoperation according to some embodiments of the present disclosure. The definitions of the coordinate systems in FIG10A are as follows: a driven tool base coordinate system {ok} of at least one driven tool, with its origin located at the base of at least one driven tool (e.g., the drive device of the driven tool, as shown in FIG5B ) or the outlet of the abdominal sheath, It is consistent with the extension line of the base or the axial direction of the abdominal sheath. The direction is shown in FIG10A. The driven tool coordinate system {g} of at least one driven tool has its origin located at the end of the tool arm of the driven tool or on the driven tool provided at the end of the tool arm. The direction is consistent with the axis of the end or the axis of the driven instrument, The direction is shown in FIG10A. The base coordinate system of the slave vision device {o3}, the origin of which is located at the base of the slave vision device (for example, the driving device of the slave vision device) or the outlet of the abdominal sheath, It is consistent with the extension line of the base or the axial direction of the abdominal sheath. The direction is shown in Figure 10A or Figure 10B. The camera coordinate system {ge} of the slave vision device has its origin at the end of the tool arm of the slave vision device or set on the endoscope (for example, on the distal end surface of the endoscope, at the midpoint of the center line connecting the binocular cameras), and the direction of the axis of the end or the axis of the endoscope is Direction, after the field of vision is adjusted, the upper part is The display coordinate system {D} has its origin at the center of the display and its vertical direction to the inside of the screen is Positive direction, the top of the screen is Direction. A driven tool image coordinate system {G} of at least one driven tool, the origin of which is located at the end of the tool arm of the driven tool or on the image of the driven tool on the display screen, The direction is consistent with the axis of the terminal image or the axis of the driven instrument image, The direction is shown in Figure 10A or Figure 10B. The main manipulator base coordinate system {M} of at least one main manipulator, the coordinate axis direction is shown in Figure 4, Figure 10A or Figure 10B. The handle coordinate system {H} of at least one main manipulator, the coordinate axis direction is shown in Figure 4, Figure 10A or Figure 10B. The reference coordinate system {w} can be the coordinate system of the space where the main manipulator or the slave tool or the endoscope is located, such as the slave tool base coordinate system {ok}, or the world coordinate system, as shown in Figure 10A or Figure 10B. In some embodiments, the operator's body sensation can be used as a reference. When the operator sits in front of the main console, the body sensation is upward. Direction, the forward direction of the body is Those skilled in the art will appreciate that the coordinate system definition is not limited to the above, and other coordinate system definitions may also be used to implement remote teleoperation of the surgical robot system.
[0086] In some embodiments, the initial posture of the driven instrument of at least one driven tool may be the posture of the image of the driven instrument of at least one driven tool in the display relative to the reference coordinate system {w}, for example, the initial posture of the driven instrument image coordinate system {G} of at least one driven tool relative to the reference coordinate system {w} W R G(i) In some embodiments, the initial pose of the driven instrument image coordinate system {G} of at least one driven tool relative to the reference coordinate system {w} W R G(i) The initial pose of the driven instrument image coordinate system {G} of at least one driven tool relative to the display coordinate system {D} can be based on D R G(i) And the transformation relationship between the display coordinate system {D} and the reference coordinate system {w} W R D get.
[0087] In some embodiments, in a three-dimensional display imaging relationship, since the field of view of the display coordinate system {D} and the camera coordinate system {ge} are consistent, the initial posture of the driven instrument image coordinate system {G} of at least one driven tool relative to the display coordinate system {D} is D R G(i) The initial pose of the driven tool coordinate system {g} of at least one driven tool relative to the camera coordinate system {ge} of the driven vision device ge R g(i) In some embodiments, as shown in FIG10A , the initial pose of the slave coordinate system {g} relative to the camera coordinate system {ge} is ge R g(i) It can be based on the initial posture of the driven tool coordinate system {g} relative to the driven tool base coordinate system {ok} okR g(i) , the transformation relationship between the base coordinate system of the driven tool {ok} and the base coordinate system of the driven visual device {o3} o3 R ok And the transformation relationship between the camera coordinate system {ge} and the base coordinate system {o3} of the slave visual device o3 R ge In some embodiments, the control device can be configured to determine the initial posture of the driven instrument image coordinate system {G} relative to the reference coordinate system {w} based on formula (1): W R G(i) , as the initial posture of the driven tool of at least one driven tool: W R G(i) = W R D D R G(i) = W R D ge R g(i) = W R D ( o3 R ge ) To3 R ok ok R g(i) (1)
[0088] In some embodiments, the control device may be configured to determine an initial posture of the driven tool coordinate system {g} of at least one driven tool relative to the driven tool base coordinate system {ok} based on driving information of at least one driving device for driving at least one driven tool. ok R g(i) In some embodiments, the control device can be configured to obtain driving information (such as angle) of at least one driven tool through a driving device sensor, and determine the initial posture of the driven tool coordinate system {g} of at least one driven tool relative to the driven tool base coordinate system {ok} based on the driving information. ok R g(i) For example, based on the driving information of at least one driven tool and the kinematic model of the tool arm of at least one driven tool, the initial posture of the driven tool coordinate system {g} relative to the driven tool base coordinate system {ok} can be calculated by the forward kinematics algorithm. ok R g(i) In some embodiments, a drive device sensor may be provided on a drive device, the drive device being used to drive a tool arm of at least one driven tool, the drive device sensor being used to obtain drive information, and the control device being able to determine an initial posture of a driven tool coordinate system {g} of at least one driven tool relative to a driven tool base coordinate system {ok} based on the drive information. ok Rg(i) For example, the drive device may include at least one drive motor, and the drive device sensor is coupled to the drive motor to record and output motor data. For example, the motor data may include binary or hexadecimal numbers, which can be converted to obtain the initial posture of the driven tool coordinate system {g} relative to the driven tool base coordinate system {ok} ok R g(i) The drive device sensor may include a potentiometer or an encoder. The potentiometer or encoder obtains information such as angle, and then determines the initial posture of the driven tool coordinate system {g} relative to the driven tool base coordinate system {ok} ok R g(i) In some embodiments, the control device may also be configured to determine an initial posture of the driven tool coordinate system {g} of at least one driven tool relative to the driven tool base coordinate system {ok} based on the sensor data of the posture sensor. ok R g(i) The position and posture sensor may be, for example, an optical fiber sensor, which is disposed on a tool arm of at least one driven tool and is used to sense the position and posture of the driven tool relative to the driven tool base coordinate system {ok}.
[0089] In some embodiments, the camera coordinate system {ge} and the base coordinate system {o3} of the slave visual device have a predetermined transformation relationship. In some embodiments, before the operator performs the operation, the slave visual device has finished moving, so that the transformation relationship between the camera coordinate system {ge} and the base coordinate system {o3} of the slave visual device is o3 R ge Similar to at least one slave tool, in some embodiments, the control device can also be configured to determine the transformation relationship between the camera coordinate system {ge} and the slave visual device base coordinate system {o3} based on the driving information of the driving device for driving the slave visual device. o3 R ge For example, based on the driving information of the driving device of the slave vision device and the kinematic model of the tool arm of the slave vision device, the transformation relationship between the camera coordinate system {ge} and the slave vision device base coordinate system {o3} can be calculated by the forward kinematics algorithm. o3 R ge .
[0090] In some embodiments, the slave tool base coordinate system {ok} and the slave vision device base coordinate system {o3} may have a predetermined transformation relationship. In some embodiments, as shown in FIG5A and FIG5C , the slave vision device 560 and at least one slave tool (e.g., the first slave tool 530) may be respectively inserted into the patient's body through the sheath on the surgical connection device 570. Thus, the transformation relationship between the slave tool base coordinate system {ok} of at least one slave tool and the slave vision device base coordinate system {o3} may be determined based on the posture relationship between the sheath for passing through at least one slave tool (e.g., the first slave tool 530) and the sheath for passing through the slave vision device 560. o3 R ok In some embodiments, at least one slave tool and a slave vision device may also be respectively arranged on two operating trolleys. The control device may be configured to determine the transformation relationship between the slave tool base coordinate system {ok} of at least one slave tool and the slave vision device base coordinate system {o3} based on the posture relationship between the two operating trolleys. o3 R ok , the specific content will be described later.
[0091] In some embodiments, the transformation relationship between the display coordinate system {D} and the reference coordinate system {w} can be predetermined. For example, the display can be fixedly mounted on a console cart, and the display coordinate system {D} and the reference coordinate system {w} have a predetermined transformation relationship.
[0092] In some embodiments, the initial posture of the handle of at least one master manipulator having an assigned relationship with the slave instrument of at least one slave tool can be the posture of the handle of at least one master manipulator relative to the reference coordinate system {w}, for example, the initial posture of the handle coordinate system {H} of at least one master manipulator relative to the reference coordinate system {w} W R H(i) In some embodiments, the initial pose of the handle coordinate system {H} of at least one master manipulator relative to the reference coordinate system {w} W R H(i) The initial posture of the handle coordinate system {H} of at least one master manipulator relative to the master manipulator base coordinate system {M} can be based on M R H(i) And the transformation relationship between the main manipulator base coordinate system {M} and the reference coordinate system {w} W R M In some embodiments, the control device can be configured to determine the initial posture of the handle coordinate system {H} relative to the reference coordinate system {w} based on formula (2): W R H(i) , as the initial posture of the handle of at least one master manipulator that has an assigned relationship with a slave instrument of at least one slave tool: W RH(i) = W R M M R H(i) (2)
[0093] In some embodiments, the control device can also be configured to obtain initial joint information of at least one posture joint; and based on the initial joint information of the at least one posture joint, determine the initial posture of the handle of at least one master manipulator. This description will be made using the first left-hand master manipulator 400 shown in FIG4 as an example, wherein the at least one master manipulator having an assigned relationship with the slave instrument of at least one slave tool is an example. In some embodiments, as shown in FIG4 , the first left-hand master manipulator 400 can be provided with master manipulator sensors (not shown) at each joint of the robotic arm 401, and initial joint information (e.g., initial joint angle data) is generated by the master manipulator sensors at each joint. In some embodiments, the master manipulator sensors are potentiometers and / or encoders. In some embodiments, the posture of the first left-hand master manipulator 400 can be represented by a collection of joint information of the master manipulator joints (e.g., a one-dimensional matrix composed of such joint information). In some embodiments, joints 5, 6, and 7 of the robotic arm 401 are posture joints used to adjust the posture of the robotic arm. The control device can be configured to determine the initial posture of the handle coordinate system {H} relative to the main manipulator base coordinate system {M} by a forward kinematics algorithm based on the initial joint information obtained by the main manipulator sensor of one or more posture joints and the kinematic model of the manipulator arm of at least one main manipulator M R H(i) .
[0094] In some embodiments, the transformation relationship between the master manipulator base coordinate system {M} and the reference coordinate system {w} can be predetermined. For example, the master manipulator can be mounted on a master control cart. Typically, the master manipulator base coordinate system {M} can be mounted on at least one support or base on which the master manipulator resides, and during teleoperation, the master manipulator base coordinate system {M} remains unchanged, and the master manipulator base coordinate system {M} and the reference coordinate system {w} have a predetermined transformation relationship.
[0095] In some embodiments, the control device can be configured to determine the posture matching degree between the handle of at least one master manipulator and the slave instrument of at least one slave tool based on the initial posture of the handle of at least one master manipulator and the initial posture of the slave instrument of at least one slave tool; and based on the posture matching degree, determine whether the handle of at least one master manipulator matches the slave instrument of at least one slave tool. In the present disclosure, the posture matching degree refers to the degree of matching between the posture of the handle of at least one master manipulator and the posture of the slave instrument of at least one slave tool. In some embodiments, the control device can be configured to determine the posture matching degree between the handle of at least one master manipulator and the slave instrument of at least one slave tool based on the initial posture of the handle coordinate system {H} of at least one master manipulator relative to the reference coordinate system {w}. W R H(i) The initial pose of the driven tool image coordinate system {G} of at least one driven tool relative to the reference coordinate system {w} D R G(i) , determining a posture matching degree between a handle of at least one master manipulator and a slave instrument of at least one slave tool. In some embodiments, the posture matching degree can be represented by a relationship between a posture difference and a threshold, such as a ratio or difference between the threshold and the posture difference.
[0096] The initial pose of the handle coordinate system {H} of at least one master manipulator relative to the reference coordinate system {w} W R H(i) It may include multiple attitude angles, such as the yaw angle of the handle coordinate system {H} of at least one master manipulator around the Y axis in the reference coordinate system {w}, the pitch angle around the X axis in the reference coordinate system {w}, and the roll angle around the Z axis in the reference coordinate system {w}. Similarly, the initial attitude of the driven instrument image coordinate system {G} of at least one driven tool relative to the reference coordinate system {w} D R G(i) Multiple posture angles may also be included. In some embodiments, the control device may be configured to determine a posture match between the handle of the at least one master manipulator and the slave of the at least one slave tool based on a posture angle of the handle coordinate system {H} of the at least one master manipulator relative to the reference coordinate system {w} and a posture angle of the slave image coordinate system {G} of the at least one slave tool relative to the reference coordinate system {w}. In some embodiments, the control device is further configured to determine that the posture of the handle of the at least one master manipulator and the slave of the at least one slave tool do not match in response to the posture match falling below a matching threshold.
[0097] In some embodiments, the control device can also be configured to determine the matching posture of the handle of at least one master manipulator based on the initial posture of the slave instrument of at least one slave tool in response to the handle of at least one master manipulator not matching the slave instrument of at least one slave tool; and generate a master manipulator control signal based on the initial posture and matching posture of the handle of at least one master manipulator.
[0098] In some embodiments, the matching posture of the handle of at least one master manipulator can be a posture for matching (e.g., aligning) the handle of at least one master manipulator with the initial posture of the slave instrument of at least one slave tool, such as the matching posture of the handle coordinate system {H} of at least one master manipulator relative to the master manipulator base coordinate system {M}. M R H(m) In some embodiments, the matching pose of the handle coordinate system {H} of at least one master manipulator relative to the master manipulator base coordinate system {M} M R H(m) The initial posture of the driven instrument image coordinate system {G} of at least one driven tool relative to the display coordinate system {D} can be D R G(i) In some embodiments, the control device may be configured to determine the initial posture of the driven tool coordinate system {g} relative to the driven tool base coordinate system {ok} based on the initial posture of the driven tool coordinate system {g} of the at least one driven tool. ok R g(i) , determine the matching posture of the handle coordinate system {H} of at least one master manipulator relative to the base coordinate system {M} of the master manipulator M R H(m) In some embodiments, the matching pose of the handle coordinate system {H} of at least one master manipulator relative to the master manipulator base coordinate system {M} M R H(m) It can be determined based on the following formula (3): M R H(m) =( ok R o3 o3 R ge D R M ) Tok R g(i) (3)
[0099] In formula (3), D R M Represents the transformation relationship between the master operator base coordinate system {M} and the display coordinate system {D} of at least one master operator. In some embodiments, the transformation relationship between the at least one master operator and the display can be predetermined. For example, the at least one master operator and the display can be fixedly mounted on a master console vehicle, and the master operator base coordinate system {M} and the display coordinate system {D} of the at least one master operator have a predetermined transformation relationship. Alternatively, the transformation relationship between the master operator base coordinate system {M} and the display coordinate system {D} of the at least one master operator can also be based on the transformation relationship between the master operator base coordinate system {M} and the reference coordinate system {w} of the at least one master operator, as well as the transformation relationship between the display coordinate system {D} and the reference coordinate system {w}.
[0100] It should be understood that the control device can also be configured to be based on the initial posture of the handle coordinate system {H} of at least one master manipulator relative to the base coordinate system {M} of the master manipulator M R H(i) and the matching posture of the handle coordinate system {H} of at least one master manipulator relative to the base coordinate system {M} of the master manipulator M R H(m) The degree of matching is used to determine whether the handle of at least one master operator matches the driven instrument of at least one driven tool.
[0101] In some embodiments, the control device is further configured to determine the initial posture of the handle coordinate system {H} of at least one master manipulator relative to the base coordinate system {M} of the master manipulator. M R H(i) The matching pose of the handle coordinate system {H} relative to the main manipulator base coordinate system {M} M R H(m) , determine the posture difference, and based on the posture difference and the inverse kinematics model of the manipulator of at least one master manipulator, generate a master manipulator control signal for controlling the manipulator of at least one master manipulator. In some embodiments, the master manipulator control signal may include a control signal for controlling at least one posture joint of the manipulator. For example, based on the difference between the initial posture and the matching posture of the handle of at least one master manipulator, the joint value of at least one posture joint included in the manipulator (or the drive value of the motor that controls the movement of at least one posture joint of the manipulator) can be determined by the inverse kinematics numerical iteration algorithm of the manipulator kinematic model. It should be understood that the kinematic model can represent a mathematical model of the motion relationship between the joint space and the task space of the manipulator. For example, the kinematic model can be established by methods such as the DH (Denavit-Hartenberg) parameter method and the exponential product representation method.
[0102] In some embodiments, the control device can be configured to, in response to a posture matching degree exceeding a matching degree threshold, determine that the handle of at least one master manipulator matches the slave instrument of at least one slave tool, and can establish a master-slave mapping between the handle of at least one master manipulator and the slave instrument of at least one slave tool. In some embodiments, the control device can also be configured to, in response to the matching of the handle of at least one master manipulator and the slave instrument of at least one slave tool, establish a master-slave mapping between the handle of at least one master manipulator and the slave instrument of at least one slave tool. By establishing the master-slave mapping, it is possible to ensure that the posture changes of the image of the slave instrument of at least one slave tool perceived by the operator and the posture changes of the handle of at least one master manipulator perceived by the operator maintain a preset transformation relationship, thereby achieving intuitive operation. In some embodiments, the control device can be configured to, after establishing the master-slave mapping between the handle of at least one master manipulator and the slave instrument of at least one slave tool, delegate control of the slave instrument of at least one slave tool to the handle of at least one master manipulator, allowing the operator to perform the surgical operation via teleoperation.
[0103] In some embodiments, the master-slave mapping of the handle of at least one master manipulator and the slave instrument of at least one slave tool may include the posture relationship between the handle of at least one master manipulator and the slave instrument of at least one slave tool. The posture relationship between the handle of at least one master manipulator and the slave instrument of at least one slave tool may include the position relationship and posture relationship between the handle and the slave instrument. In some embodiments, the position relationship between the handle of at least one master manipulator and the slave instrument of at least one slave tool may include the relationship between the position change amount of the handle and the position change amount of the slave instrument. The posture relationship between the handle of at least one master manipulator and the slave instrument of at least one slave tool may include the relationship between the posture change amount of the handle and the posture change amount of the slave instrument.
[0104] In some embodiments, the control device can be configured to obtain the current posture of the handle of at least one master manipulator; obtain the previous posture of the handle of at least one master manipulator; obtain the starting posture of the slave instrument of at least one slave tool; determine the target posture of the slave instrument of at least one slave tool based on the previous posture of the handle of at least one master manipulator, the current posture of the handle of at least one master manipulator, the starting posture of the slave instrument of at least one slave tool and the posture relationship between the handle of at least one master manipulator and the slave instrument of at least one slave tool; and generate a slave tool control signal based on the target posture of the slave instrument of at least one slave tool, and the slave tool control signal is used to control the movement of the slave instrument of at least one slave tool.
[0105] In some embodiments, the control device can be configured to obtain a current position of a handle of at least one master manipulator, the current position including a current position and a current posture. In some embodiments, the position of the handle of at least one master manipulator can be the position of the handle of at least one master manipulator relative to a reference coordinate system {w}, for example, the current position of the handle coordinate system {H} of at least one master manipulator relative to the reference coordinate system {w}. In some embodiments, the current position of the handle coordinate system {H} of at least one master manipulator relative to the reference coordinate system {w} can be obtained based on the current position of the handle coordinate system {H} of at least one master manipulator relative to the master manipulator base coordinate system {M} and the transformation relationship between the master manipulator base coordinate system {M} and the reference coordinate system {w}. In some embodiments, obtaining the current position of the handle of at least one master manipulator includes obtaining the current position of the handle coordinate system {H} of at least one master manipulator relative to the reference coordinate system {w}, and obtaining the current posture of the handle of at least one master manipulator includes obtaining the current posture of the handle coordinate system {H} of at least one master manipulator relative to the reference coordinate system {w}.
[0106] In some embodiments, similar to determining the initial posture of the handle of at least one main manipulator, the control device can also be configured to obtain current joint information of at least one joint, and determine the current posture of the handle of at least one main manipulator based on the current joint information of at least one joint. In some embodiments, the control device can be configured to obtain joint information (position or angle) of the corresponding joint based on the main manipulator sensor, and calculate the current posture of the handle of at least one main manipulator. For example, the control device can be configured to calculate the current posture of the handle of at least one main manipulator based on the joint information (such as angle) obtained by the main manipulator sensor of at least one posture joint and the forward kinematics algorithm, and calculate the current position of the handle of at least one main manipulator based on the joint information (such as position) obtained by the main manipulator sensor of at least one position joint and the forward kinematics algorithm.
[0107] In some embodiments, the control device may be configured to obtain a previous position of a handle of at least one master manipulator, the previous position comprising a previous position and a previous posture. In some embodiments, obtaining the previous position of the handle of at least one master manipulator comprises obtaining a previous position of a handle coordinate system {H} of the at least one master manipulator relative to a reference coordinate system {w}, and obtaining the previous posture of the handle of at least one master manipulator comprises obtaining a previous posture of the handle coordinate system {H} of the at least one master manipulator relative to the reference coordinate system {w}.
[0108] In some embodiments, similar to determining the initial pose of the handle of at least one master manipulator and obtaining the current pose of the handle of at least one master manipulator, the control device may receive previous joint information of at least one joint of the at least one master manipulator and determine the previous pose of the handle of the at least one master manipulator based on the previous joint information of the at least one joint. For example, the control device may determine the previous pose and current pose of the handle of the at least one master manipulator based on joint information of the at least one master manipulator read by a master manipulator sensor at a previous time and a current time.
[0109] In some embodiments, the control device can be configured to obtain a starting posture of the slave instrument of at least one slave tool, where the starting posture includes a starting position and a starting attitude. In some embodiments, the starting posture of the slave instrument of at least one slave tool can be the starting posture of the slave instrument of at least one slave tool relative to the slave tool base coordinate system {ok}, for example, the starting posture of the slave instrument coordinate system {g} of at least one slave tool relative to the slave tool base coordinate system {ok}. In some embodiments, obtaining the starting position of the slave instrument of at least one slave tool includes obtaining the starting position of the slave instrument coordinate system {g} of at least one slave tool relative to the slave tool base coordinate system {ok}, and obtaining the starting attitude of the slave instrument of at least one slave tool includes obtaining the starting attitude of the slave instrument coordinate system {g} of at least one slave tool relative to the slave tool base coordinate system {ok}. In some embodiments, the control device can receive the target posture of the slave instrument of at least one slave tool obtained in the previous control cycle as the starting posture of the slave instrument of at least one slave tool in the current control cycle. For the first round of control cycle, the initial posture of the driven instrument of at least one driven tool (for example, the zero position of at least one driven tool) may be used as the starting posture of the first round of control cycle.
[0110] In some embodiments, the control device may be configured to determine a change in the pose of the handle of the at least one master manipulator based on a previous pose and a current pose of the handle of the at least one master manipulator. For example, a change in the position of the handle of the at least one master manipulator in the reference coordinate system {w} may be determined based on a previous position and a current position of the handle coordinate system {H} of the at least one master manipulator relative to the reference coordinate system {w}, and a change in the pose of the handle of the at least one master manipulator in the reference coordinate system {w} may be determined based on a previous pose and a current pose of the handle coordinate system {H} of the at least one master manipulator relative to the reference coordinate system {w}.
[0111] In some embodiments, the control device may be further configured to determine a position change of a slave instrument of at least one slave tool based on a position change of a handle of at least one master manipulator and a positional relationship between the handle of at least one master manipulator and a slave instrument of at least one slave tool. For example, a position change of the slave instrument of at least one slave tool may be determined based on a position change of the handle of at least one master manipulator and a positional relationship between the handle and the slave instrument, and a position change of the slave instrument of at least one slave tool may be determined based on a position change of the handle of at least one master manipulator and a positional relationship between the handle and the slave instrument.
[0112] In some embodiments, the control device may also be configured to determine a target posture of the slave of at least one slave tool based on the starting posture of the slave of at least one slave tool and the posture change of the slave of at least one slave tool, wherein the target posture includes a target position and a target posture. In some embodiments, the target posture of the slave of at least one slave tool may be the target posture of the slave of at least one slave tool relative to the slave base coordinate system {ok}, for example, the target posture of the slave coordinate system {g} of at least one slave tool relative to the slave base coordinate system {ok}. For example, the target position of the slave of at least one slave tool may be determined based on the starting position of the slave of at least one slave tool and the position change of the slave of at least one slave tool, and the target posture of the slave of at least one slave tool may be determined based on the starting posture of the slave of at least one slave tool and the posture change of the slave of at least one slave tool.
[0113] In some embodiments, the posture relationship may include a position change of the image of the slave instrument of at least one slave tool on the display relative to the reference coordinate system {w} being proportional to a position change of the handle of at least one master manipulator relative to the reference coordinate system {w}, and / or a posture change of the image of the slave instrument of at least one slave tool on the display relative to the reference coordinate system {w} being consistent with a posture change of the handle of at least one master manipulator relative to the reference coordinate system {w}. For example, the posture relationship may include a position change of the slave instrument image coordinate system {G} of at least one slave tool relative to the reference coordinate system {w} being proportional to a position change of the handle coordinate system {H} of at least one master manipulator relative to the reference coordinate system {w}, and / or a posture change of the slave instrument image coordinate system {G} of at least one slave tool relative to the reference coordinate system {w} being consistent with a posture change of the handle coordinate system {H} of at least one master manipulator relative to the reference coordinate system {w}, which may be expressed as:
[0114] In formula (4), D p G(t) 、D R G(t) respectively represent the target position and target posture of the driven tool image coordinate system {G} relative to the display coordinate system {D} of at least one driven tool, D p G(s) 、 D R G(s) represent the starting position and starting posture of the driven tool image coordinate system {G} relative to the display coordinate system {D} of at least one driven tool, respectively, M p H 、 M R H Respectively represent the current position and current posture of the handle coordinate system {H} of at least one master manipulator relative to the base coordinate system {M} of the master manipulator, M p H* 、 M R H* represent the previous position and previous posture of the handle coordinate system {H} of at least one master manipulator relative to the base coordinate system {M} of the master manipulator, respectively, W R D Represents the transformation relationship between the display coordinate system {D} and the reference coordinate system {w}, W R M represents the transformation relationship between the main manipulator base coordinate system {M} and the reference coordinate system {w}, k S W The master-slave linear proportional coefficient.
[0115] In some embodiments, during motion of at least one slave tool, the slave tool's image on the display under the endoscopic camera consistently satisfies a three-dimensional display imaging relationship. This three-dimensional display imaging relationship includes the posture of the at least one slave tool's image on the display relative to the display coordinate system {D} being consistent with the posture of the slave tool relative to the camera coordinate system {ge}, and maintaining a proportional relationship between their positions.
[0116] In some embodiments, the three-dimensional imaging display relationship of the driven instrument of at least one driven tool in the starting position can be expressed as:
[0117] In formula (5), ge p g(s) 、 ge R g(s) represent the starting position and starting posture of the driven tool of at least one driven tool relative to the camera coordinate system {ge}, ok p g(s) 、 ok R g(s)represent the starting position and starting posture of the driven tool of at least one driven tool relative to the driven tool base coordinate system {ok}, respectively, o3 R ge Represents the transformation relationship between the camera coordinate system {ge} and the slave visual device base coordinate system {o3}, o3 R ok k represents the transformation relationship between the slave tool base coordinate system {ok} and the slave vision device base coordinate system {o3}, D Indicates the display imaging ratio.
[0118] In some embodiments, the three-dimensional imaging display relationship of the driven instrument of at least one driven tool in the target posture can be expressed as:
[0119] In formula (6), ge p g(t) 、 ge R g(t) represent the target position and target posture of the driven tool of at least one driven tool relative to the camera coordinate system {ge}, ok p g(t) 、 ok R g(t) Respectively represent the target position and target posture of the driven tool of at least one driven tool relative to the driven tool base coordinate system {ok}.
[0120] By substituting formula (5) and formula (6) into formula (4), the target position of the driven instrument of at least one driven tool during the teleoperation process can be obtained: ok p g(t) and target posture ok R g(t) The expression is as follows:
[0121] In some embodiments, the control device can be configured to generate a slave control signal based on the starting and target poses of the slave of at least one slave tool, the slave control signal being used to control the motion of the slave of the at least one slave tool. In some embodiments, the control device can also be configured to determine a posture difference based on the starting and target poses of the slave of the at least one slave tool; and determine a drive signal for controlling the motion of the slave of the at least one slave tool based on the posture difference and an inverse kinematic model of the tool arm of the at least one slave tool. For example, based on the difference between the target and starting poses of the slave of the at least one slave tool in a world coordinate system, a numerical inverse kinematics iteration algorithm of the tool arm kinematic model can be used to determine the drive values of the multiple joints included in the tool arm (or the drive values of the corresponding multiple motors controlling the motion of the manipulator arm) within a current motion control cycle. It should be understood that the kinematic model can represent a mathematical model of the kinematic relationship between the joint space and task space of the tool arm. For example, the kinematic model can be established using methods such as the Denavit-Hartenberg (DH) parameter method and the exponential product representation method.
[0122] In some embodiments, the driven instrument of at least one driven tool may be iteratively controlled to move to a target posture through a plurality of motion control cycles having a predetermined period.
[0123] FIG10B shows a schematic diagram of a coordinate system in remote teleoperation according to other embodiments of the present disclosure. The definitions of the coordinate systems in FIG10B are as follows: The first operating trolley coordinate system {V1}, the origin of which is located on the trolley body of the first operating trolley 1010, and the directions of the coordinate axes are shown in FIG10B. The second operating trolley coordinate system {V2}, the origin of which is located on the trolley body of the second operating trolley 1020, and the directions of the coordinate axes are shown in FIG10B. The fourth slave tool base coordinate system {ok4} of the fourth slave tool as at least one slave tool, the origin of which is located at the base of the fourth slave tool (for example, it can be the end of the moving arm of the second slave trolley, such as the third swing arm 624 shown in FIG6 ), In line with the extension line of the base, The fourth slave coordinate system {g4} of the fourth slave tool has its origin located at the end of the tool arm of the slave tool or on the slave tool provided at the end of the tool arm. The direction is consistent with the axis of the end or the axis of the driven instrument, The directions are shown in FIG10B . The coordinate systems in FIG10B , including the slave vision device base coordinate system {o3}, the slave vision device camera coordinate system {ge}, the display coordinate system {D}, the slave instrument image coordinate system {G} of at least one slave tool, the master manipulator base coordinate system {M} of at least one master manipulator, and the reference coordinate system {w}, are defined in the same manner as in FIG10A , and their description is omitted here. Those skilled in the art will appreciate that the coordinate system definition method is not limited to the above, and other coordinate system definitions may also be used to implement remote teleoperation of the surgical robot system.
[0124] In some embodiments, as shown in FIG10B , the surgical robot system 1000 may include a first operating trolley 1010 and a second operating trolley 1020. In some embodiments, the first operating trolley 1010 may be used to carry multiple slave tools, such as a first slave tool, a second slave tool, and a third slave tool (not shown), and the second operating trolley 1020 may be used to carry at least one slave tool, such as a fourth slave tool. In some embodiments, the first operating trolley 1010 or the second operating trolley 1020 may also be used to carry a slave vision device, such as an endoscopic device. The following description will take the first operating trolley 1010 carrying a slave vision device as an example.
[0125] In some embodiments, the control device can be configured to obtain a position of a first operating trolley; obtain a position of a second operating trolley; determine a transformation relationship between the first operating trolley coordinate system and the second operating trolley coordinate system based on the position of the first operating trolley and the second operating trolley; and determine a transformation relationship between a slave tool base coordinate system and a slave vision device base coordinate system of at least one slave tool based on the transformation relationship between the first operating trolley coordinate system and the second operating trolley coordinate system. In some embodiments, the position of the first operating trolley 1010 can include the position of the first operating trolley coordinate system {V1} relative to the reference coordinate system {w}, and the position of the second operating trolley 1020 can include the position of the second operating trolley coordinate system {V2} relative to the reference coordinate system {w}.
[0126] In some embodiments, the surgical robot system 1000 may further include at least one positioning sensing unit 1030 for sensing the positioning information of the first and / or second operating trolleys. The control device may be connected to the at least one positioning sensing unit 1030. In some embodiments, the control device may be configured to obtain the positions of the first and second operating trolleys based on the positioning information of the first and second operating trolleys. In some embodiments, the at least one positioning sensing unit 1030 may include a first and a second positioning sensing unit for respectively sensing the positioning information of the first and second operating trolleys, and the first and second positioning sensing units may have a predetermined position relationship. In some embodiments, the positioning sensing unit 1030 may be used to sense the positioning information of a positioning unit. The positioning unit may be provided on each trolley of the surgical robot system (e.g., the first and second operating trolleys), and may include at least one of an acoustic positioning unit, an electromagnetic positioning unit, and an optical positioning unit. The positioning information may include at least one of acoustic positioning information, electromagnetic positioning information, and optical positioning information.
[0127] In some embodiments, the positioning sensing unit may include an image acquisition device for acquiring a positioning image of the operating trolley. Those skilled in the art will appreciate that at least one positioning sensing unit 1030 may also be integrated into an equipment trolley (e.g., the equipment trolley 800 shown in FIG8 ), such as the at least one positioning sensing unit 830 shown in FIG8 . In some embodiments, at least one positioning sensing unit 1030 may also be integrated into the second operating trolley 1020. The second operating trolley 1020 or the equipment trolley 800 can identify the target posture through the positioning sensing unit 1030 and automatically reach the target posture in the operating room. The target posture may be associated with the posture of the first operating trolley 1010 or the surgical procedure or position of the patient.
[0128] In some embodiments, the control device can be configured to determine the posture of the operating trolley based on the positioning image. The control device can perform image processing based on the positioning image of the operating trolley captured by the image acquisition device to determine the posture of the operating trolley. For example, at least one positioning tag can be provided on the operating trolley, and at least one positioning tag can be provided on the trolley body of the operating trolley (for example, the first trolley body 510 of the first operating trolley 500 shown in Figure 5A or the first trolley body 510 of the first operating trolley 500' shown in Figure 5C, or the second trolley body 610 of the second operating trolley 600 shown in Figure 6). The posture of the operating trolley can be determined by identifying the positioning tag in the positioning image captured by the image acquisition device.
[0129] In some embodiments, the control device may also be configured to determine the position of the operating table based on other types of positioning information detected by the positioning sensing unit. For example, the control device may determine the position of the operating table based on at least one of acoustic positioning information, electromagnetic positioning information, and optical positioning information detected by the positioning sensing unit.
[0130] In some embodiments, the control device can be configured to determine a transformation relationship between the first operating trolley coordinate system and the second operating trolley coordinate system based on the positions of the first operating trolley and the second operating trolley. For example, the control device can be configured to determine a transformation relationship between the first operating trolley coordinate system {V1} and the second operating trolley coordinate system {V2} based on the position of the first operating trolley coordinate system {V1} relative to the reference coordinate system {w} and the position of the second operating trolley coordinate system {V2} relative to the reference coordinate system {w}.
[0131] In some embodiments, the control device is further configured to determine a transformation relationship between a slave tool base coordinate system and a slave vision device base coordinate system of at least one of the plurality of slave tools based on a transformation relationship between the first operating trolley coordinate system and the second operating trolley coordinate system. For example, the control device may determine a transformation relationship between a fourth slave tool base coordinate system on a second operating trolley that does not carry a slave vision device and a slave vision device base coordinate system of a slave vision device carried on the first operating trolley based on the transformation relationship between the first operating trolley coordinate system and the second operating trolley coordinate system.
[0132] As shown in FIG10B , the control device may further be configured to determine a transformation relationship between the fourth slave tool base coordinate system {ok4} and the slave vision device base coordinate system {o3} based on a transformation relationship between the slave vision device base coordinate system {o3} of the slave vision device mounted on the first operating trolley and the first operating trolley coordinate system {V1}, a transformation relationship between the fourth slave tool base coordinate system {ok4} of the fourth slave tool mounted on the second operating trolley and the second operating trolley coordinate system {V2}, and a transformation relationship between the first operating trolley coordinate system {V1} and the second operating trolley coordinate system {V2}. In some embodiments, the slave vision device base coordinate system {o3} and the first operating trolley coordinate system {V1} may have a predetermined transformation relationship, for example, which may be determined based on the configuration of the first operating trolley, and the fourth slave tool base coordinate system {ok4} of the fourth slave tool may have a predetermined transformation relationship with the second operating trolley coordinate system {V2}, for example, which may be determined based on the configuration of the second operating trolley. In the present disclosure, the configuration of the operating trolley may include the size of the operating trolley (eg, the height, length, etc. of the operating trolley) and / or the configuration of the motion arm provided on the operating trolley.
[0133] It should be understood that, as the first operating trolley equipped with a slave vision device, the slave tool base coordinate systems {ok1}-{ok3} of the first to third slave tools (not shown in the figure) carried on the first operating trolley and the slave vision device base coordinate system {o3} can have a predetermined transformation relationship. In some embodiments, as shown in FIG5A , the slave vision device 560 and at least one slave tool (for example, three slave tools 530 as the first to third slave tools) can be respectively inserted into the patient's body through the sheath on the surgical connection device 570. Thus, the transformation relationship between the slave tool base coordinate systems {ok1}-{ok3} of the first to third slave tools and the slave vision device base coordinate system {o3} can be determined based on the posture relationship between the sheath for passing through at least one slave tool (for example, the three slave tools 530 as the first to third slave tools) and the sheath for passing through the slave vision device 560.
[0134] In some embodiments, the control device can also be configured to: based on the transformation relationship between the slave tool base coordinate system of at least one slave tool and the slave vision device base coordinate system, control the slave instrument of at least one slave tool to match with the handle of at least one master manipulator and / or establish a master-slave mapping between the slave instrument of at least one slave tool and the handle of at least one master manipulator. In some embodiments, the control device can be configured to control the slave instrument of at least one slave tool to match with the handle of at least one master manipulator and / or establish a master-slave mapping between the slave instrument of at least one slave tool and the handle of at least one master manipulator based on the transformation relationship between the slave tool base coordinate systems {ok1}-{ok4} of the first to fourth slave tools and the slave vision device base coordinate system {o3} and the transformation relationship between the master manipulator base coordinate system {M} of at least one master manipulator among the multiple master manipulators and the display coordinate system {D}. In some embodiments, the transformation relationship between the at least one master manipulator and the display can be predetermined, for example, the at least one master manipulator and the display can be fixedly arranged on the master control trolley respectively, and the master manipulator base coordinate system {M} of the at least one master manipulator and the display coordinate system {D} have a predetermined transformation relationship. Alternatively, the transformation relationship between the master manipulator base coordinate system {M} of at least one master manipulator and the display coordinate system {D} may also be obtained based on the transformation relationship between the master manipulator base coordinate system {M} of at least one master manipulator and the reference coordinate system {w} and the transformation relationship between the display coordinate system {D} and the reference coordinate system {w}.
[0135] It should be understood that controlling the matching of a slave instrument of at least one slave tool with the handle of at least one master operator and / or establishing a master-slave mapping of a slave instrument of at least one slave tool with the handle of at least one master operator can be implemented similarly to the method of matching a slave tool with a master operator and / or establishing a master-slave mapping shown in Figure 10A.
[0136] In some embodiments, the control device is further configured to generate a slave tool control signal based on the movement of the handle of at least one master manipulator in response to a master-slave mapping having been established between the slave instrument of at least one slave tool and the handle of at least one master manipulator, wherein the slave tool control signal is used to control the movement of the slave instrument of at least one slave tool. For example, the control device can be configured to obtain the current posture of the handle of at least one master manipulator; obtain the previous posture of the handle of at least one master manipulator; obtain the starting posture of the slave instrument of at least one slave tool; determine the target posture of the slave instrument of at least one slave tool based on the previous posture of the handle of at least one master manipulator, the current posture of the handle of at least one master manipulator, the starting posture of the slave instrument of at least one slave tool, and the posture relationship between the handle of at least one master manipulator and the slave instrument of at least one slave tool; and generate a slave tool control signal based on the target posture of the slave instrument of at least one slave tool, wherein the slave tool control signal is used to control the movement of the slave instrument of at least one slave tool.
[0137] Before or during a surgical procedure, an operator may need to remotely control a slave visual device to adjust the surgical field of view. In some embodiments, the control device may be further configured to, in response to a slave visual device assignment request, assign the slave visual device to the handle of at least one master manipulator among a plurality of master manipulators; establish a master-slave mapping between the handle of at least one master manipulator and the slave visual device; disconnect the master-slave mapping between the handles of other master manipulators among the plurality of master manipulators and the slave instruments of other slave tools among the plurality of slave tools; and control the movement of the slave visual device based on the movement of the handle of at least one master manipulator to change the field of view of the slave visual device.
[0138] FIG11 is a schematic diagram illustrating the assignment of slave visual devices according to some embodiments of the present disclosure. In some embodiments, as shown in FIG11 , the surgical robot system is in a state where a first slave tool 1131, a second slave tool 1132, a third slave tool 1133, and a fourth slave tool 1141 are assigned to a first left-hand master manipulator 1111a, a first right-hand master manipulator 1111b, a second left-hand master manipulator 1121a, and a second right-hand master manipulator 1121b, respectively (the solid arrows in the figure indicate the assignment of at least one master manipulator to at least one slave tool).
[0139] In some embodiments, similar to assigning at least one slave tool, the control device can be configured to determine whether the at least one master operator involved in the visual tool assignment request meets the visual tool assignment condition based on the visual tool assignment request, and in response to meeting the visual tool assignment condition, assign the slave visual instrument of the slave visual device to the handle of at least one master operator. In some embodiments, the slave visual device can be operated by a master operator alone or by two master operators simultaneously. In some embodiments, the visual tool assignment condition can include that the assignment priority of at least one master operator is higher. It should be understood that during the operation, the operation requirements and field of view requirements of the first operator as the surgeon need to be met first, so the first left-hand master operator and the first right-hand master operator operated by the first operator can have a higher assignment priority than the second left-hand master operator and the second right-hand master operator operated by the second operator.
[0140] In some embodiments, the control device can be configured to, in response to a master operator's request for allocation of a slave visual device with a higher priority, allocate the slave visual device to the master operator with a higher priority. For example, as shown by the dotted arrow in FIG11 , the control device can be configured to, when a first operator issues a visual tool allocation request for a slave visual device 1160 that is in an unassigned state, allocate the slave visual device 1160 to the first left-hand master operator 1111a and / or the first right-hand master operator 1111b operated by the first operator. Alternatively, the control device can be configured to, when a first operator issues a visual tool allocation request for a slave visual device 1160 that has already been assigned to a second operator, prompt the second operator and allocate the slave visual device 1160 to the first left-hand master operator 1111a and / or the first right-hand master operator 1111b operated by the first operator. In some embodiments, the control device can be configured to, in response to a master operator's request for allocation of a slave visual device with a lower priority, allocate the slave visual device to the master operator with a lower priority based on the allocation permission. For example, as shown by the dotted arrow in Figure 11, the control device can be configured to send a request information to the first operator when the second operator issues a visual tool allocation request to the slave visual device 1160 that is in an unassigned state or has been assigned to the first operator, and when the first operator approves the allocation request, the slave visual device is assigned to the second left-hand master operator 1121a and / or the second right-hand master operator 1121b operated by the second operator.
[0141] In some embodiments, the control device may be further configured to control the movement of the slave vision device based on the movement of the handle of at least one master manipulator to change the field of view of the slave vision device. In some embodiments, the control device may be configured to generate a vision tool control signal for controlling the movement of the slave vision instrument of the slave vision device based on the posture change of the handle of at least one master manipulator and the master-slave mapping between the handle of at least one master manipulator and the slave vision device.
[0142] In some embodiments, similar to at least one slave tool, the control device may also be configured to determine whether the handle of at least one master manipulator matches the slave vision instrument of the slave vision device after assigning the slave vision device to the corresponding at least one master manipulator. In some embodiments, the control device may also be configured to generate a handle master manipulator control signal for controlling the at least one master manipulator in response to the handle of at least one master manipulator not matching the slave vision instrument of the slave vision device; or to establish a master-slave mapping between the handle of at least one master manipulator and the slave vision instrument of the slave vision device in response to the handle of at least one master manipulator matching the slave vision device. Those skilled in the art will understand that the master-slave mapping between the handle of the master manipulator and the slave vision instrument can be established without considering the matching between the handle of the master manipulator and the slave vision instrument of the slave vision device.
[0143] In some embodiments, the slave vision device can be adjusted based on the position change of the handle of at least one master manipulator. In the case where the slave vision device is operated simultaneously by two master manipulators, the position change of the slave vision instrument of the slave vision device can be the synthesis of the position change of the two master manipulators, and the posture change can be the synthesis of the posture change of the two master manipulators. The master-slave mapping of the handle of at least one master manipulator and the slave vision device can include that the position change of the slave vision instrument of the slave vision device is proportional to the position change of the handle of at least one master manipulator; or the posture change of the slave vision instrument of the slave vision device is consistent with or proportional to the posture change of the handle of at least one master manipulator.
[0144] In some embodiments, the control device can also be configured to establish a master-slave mapping in response to the handle of at least one master operator and the slave visual instrument of the slave visual device, and disconnect the master-slave mapping of the handles of other master operators among multiple master operators and the slave instruments of other slave tools among multiple slave tools, so as to prevent the operator from performing non-intuitive surgical operations due to changes in the field of view, thereby causing surgical accidents.
[0145] After completing the remote operation of the slave visual device, the operator needs to re-operate the slave tool to perform the surgical operation. Since the movement of the slave visual device causes the surgical field of view to change, in order to re-achieve intuitive operation, it is necessary to re-match at least one of the multiple slave tools and at least one master manipulator among the multiple master manipulators. In some embodiments, the control device can also be configured to restore the allocation relationship between at least one of the multiple slave tools and at least one master manipulator among the multiple master manipulators in response to the disconnection of the master-slave mapping of the slave visual device; and in response to the change in the field of view of the slave visual device, control the handle of at least one master manipulator among the multiple master manipulators to match the slave instrument of at least one of the multiple slave tools with the allocation relationship. As shown in Figure 11, the control device can disconnect the master-slave mapping between the slave visual device and at least one master manipulator after the operator confirms that the remote operation of the slave visual device is completed, and restore the allocation relationship between at least one of the multiple slave tools and at least one master manipulator among the multiple master manipulators to the state before the remote operation of the slave visual device was performed. In some embodiments, the control device can be configured to control the handle of at least one master manipulator among multiple master manipulators to match the slave instrument of at least one slave tool among multiple slave tools having an assigned relationship in response to a change in the posture of the slave visual device, and establish a master-slave mapping between the handle of at least one master manipulator and the slave instrument of at least one slave tool in response to the handle of at least one master manipulator matching the slave instrument of at least one slave tool.
[0146] In some embodiments, the control device can also be configured to determine whether the slave instruments of multiple slave tools are located within the field of view after the field of view of the slave visual device changes, and in response to the slave instrument of at least one of the multiple slave tools being located outside the field of view, generate prompt information to guide the operator to control the movement of the slave tool so that the slave instrument returns to the field of view, or to return the slave visual device to the position before the field of view changes, so as to guide the operator to control the slave tool to reach the area after the field of view changes.
[0147] The present disclosure also includes the following embodiments.
[0148] 1. A surgical robot system, comprising:
[0149] a plurality of operating trolleys for carrying a plurality of slave tools and slave vision devices, the plurality of operating trolleys comprising at least a first operating trolley and a second operating trolley, the plurality of slave tools comprising at least a first slave tool, a second slave tool, a third slave tool, and a fourth slave tool, the plurality of operating trolleys being configured such that the first operating trolley is configured to carry at least the first slave tool, the second slave tool, the third slave tool, and the slave vision device, and the second operating trolley is configured to carry at least the fourth slave tool, or the first operating trolley is configured to carry at least the first slave tool, the second slave tool, the third slave tool, and the fourth slave tool, and the second operating trolley is configured to carry at least the slave vision device;
[0150] a plurality of master operators, the plurality of master operators comprising at least a first left-hand master operator, a first right-hand master operator, a second left-hand master operator, and a second right-hand master operator; and
[0151] A control device is connected to the plurality of slave tools and the plurality of master operators, and is configured to control the movement of a slave instrument of at least one of the plurality of slave tools based on the movement of a handle of at least one of the plurality of master operators.
[0152] 2. According to the surgical robot system of item 1, the control device is further configured to:
[0153] Obtaining the position and posture of the first operating table;
[0154] Obtaining the position and posture of the second operating table;
[0155] Determining a transformation relationship between the first operating trolley coordinate system and the second operating trolley coordinate system based on the positions of the first operating trolley and the second operating trolley; and
[0156] Based on the transformation relationship between the first operating trolley coordinate system and the second operating trolley coordinate system, the transformation relationship between the slave tool base coordinate system of the at least one slave tool and the slave vision device base coordinate system is determined.
[0157] 3. According to the surgical robot system of item 2, the control device is further configured to:
[0158] Based on the transformation relationship between the slave tool base coordinate system of the at least one slave tool and the slave vision device base coordinate system, the slave instrument of the at least one slave tool is controlled to match the handle of the at least one master operator and / or a master-slave mapping is established between the slave instrument of the at least one slave tool and the handle of the at least one master operator.
[0159] 4. According to the surgical robot system of item 3, the control device is further configured to:
[0160] In response to a master-slave mapping having been established between the slave instrument of the at least one slave tool and the handle of the at least one master operator, a slave tool control signal is generated based on the movement of the handle of the at least one master operator, and the slave tool control signal is used to control the movement of the slave instrument of the at least one slave tool.
[0161] 5. The surgical robot system according to any one of items 1 to 4, wherein the control device is further configured to:
[0162] In response to a preset or assignment request, the at least one slave tool is assigned to the at least one master operator.
[0163] 6. The surgical robot system according to any one of items 1 to 5, wherein the control device is further configured to:
[0164] In response to an assignment request of the slave visual device, assigning the slave visual device to a handle of at least one master operator;
[0165] Establishing a master-slave mapping between a handle of the at least one master operator and the slave visual device;
[0166] disconnecting the master-slave mapping between the handles of other master operators among the plurality of master operators and the associated slave instruments of the at least one slave tool; and
[0167] Based on the handle movement of the at least one master manipulator, the slave vision device is controlled to move to change the field of view of the slave vision device.
[0168] 7. According to the surgical robot system of item 6, the control device is further configured to:
[0169] In response to the master-slave mapping of the slave vision device being disconnected, restoring the assignment relationship between the at least one slave tool and the at least one master operator; and
[0170] In response to a change in the field of view of the slave visual device, the handle of the at least one master manipulator is controlled to match with a slave instrument of the at least one slave tool having an assigned relationship.
[0171] 8. The surgical robot system according to item 1 or 2, wherein the first operating trolley further comprises:
[0172] The first vehicle body; and
[0173] a first moving arm, wherein the proximal end of the first moving arm is used for rotationally connecting with the first trolley body, and the distal end is used for carrying at least the first driven tool, the second driven tool, the third driven tool and the fourth driven tool or the driven vision device;
[0174] The first motion arm comprises:
[0175] a positioning link mechanism, a proximal end of which is rotatably connected to the first trolley body; and
[0176] A remote center of motion (RCM) mechanism, wherein the RCM mechanism is configured so that the proximal end can rotate relative to the distal end of the positioning link mechanism, and the RCM mechanism includes a plurality of arcuate arms, the proximal ends and distal ends of the plurality of arcuate arms are respectively and sequentially connected in rotation, and the rotation axes of the plurality of arcuate arms intersect at the remote center of motion.
[0177] 9. The surgical robot system according to item 8,
[0178] The first vehicle body includes:
[0179] base;
[0180] A column, arranged on the base;
[0181] A crossbeam is provided at the top end of the column, and the distal end of the crossbeam is rotatably connected to the proximal end of the positioning link mechanism.
[0182] The first operating trolley is configured as follows: the column of the first trolley body includes a column lifting joint for enabling the column to be raised and lowered relative to the base, or the first motion arm also includes a vertical arm lifting mechanism, the proximal end of the vertical arm lifting mechanism is connected to the distal end of the positioning link mechanism, and the distal end is connected to the proximal end of the RCM mechanism, and the vertical arm lifting mechanism includes a vertical arm and a vertical arm lifting joint for enabling the vertical arm to be raised and lowered relative to the positioning link mechanism.
[0183] 10. The surgical robot system according to item 8, wherein the first motion arm further comprises:
[0184] A mounting platform is fixedly arranged at a distal end of an arc-shaped arm located away from the positioning link mechanism among the plurality of arc-shaped arms, the mounting platform including a plurality of mounting positions;
[0185] a plurality of linear modules, wherein the plurality of linear modules are respectively arranged on the plurality of mounting positions; and
[0186] Multiple driving devices are used to drive at least the first driven tool, the second driven tool, the third driven tool and the fourth driven tool or the driven visual device. The multiple driving devices are respectively mounted on the multiple linear modules to move linearly under the drive of the multiple linear modules.
[0187] 11. The surgical robot system according to item 10,
[0188] The plurality of driving devices include at least a first driving device, a second driving device, a third driving device and a fourth driving device, for driving the first driven tool, the second driven tool, the third driven tool and the fourth driven tool or the driven visual device respectively.
[0189] The plurality of linear modules at least include a first linear module, a second linear module, a third linear module and a fourth linear module, which are used to carry the first driving device, the second driving device, the third driving device and the fourth driving device respectively.
[0190] The multiple mounting positions include at least a first mounting position, a second mounting position, a third mounting position and a fourth mounting position arranged at intervals around the center of the mounting platform, and are used to respectively mount the first linear module, the second linear module, the third linear module and the fourth linear module. When the first linear module, the second linear module, the third linear module and the fourth linear module are mounted on the mounting platform, the extension lines of the far ends converge toward the remote motion center.
[0191] 12. According to the surgical robot system of item 1 or 2, the second operating table further comprises:
[0192] A second vehicle body; and
[0193] A second moving arm, wherein the proximal end of the second moving arm is used to be connected to the second trolley body, and the distal end is used to carry at least the fourth driven tool or the driven visual device.
[0194] 13. The surgical robot system according to item 12,
[0195] The second operating table further includes a fourth driving device for driving the fourth driven tool or the driven visual device, and the fourth driving device is mounted on the distal end of the second motion arm.
[0196] The second motion arm includes a vertical arm and at least one swing arm connected in sequence, the proximal end of the vertical arm is rotationally or fixedly connected to the second trolley body, the proximal end of the at least one swing arm is rotationally connected to the distal end of the vertical arm so as to rotate around a horizontal axis relative to the vertical arm, and the proximal end of the at least one swing arm is used to carry the fourth drive device or the slave visual device.
[0197] 14. According to any one of Articles 1-13 of the surgical robot system, the control device is also configured to assign the slave instrument of the at least one slave tool to the handle of the at least one master manipulator in response to satisfying an assignment condition, wherein the assignment condition includes that the at least one slave tool is not assigned and / or the assignment priority of the at least one master manipulator is higher.
[0198] 15. The surgical robot system according to Item 14, wherein the first left-hand master manipulator and the first right-hand master manipulator have a higher allocation priority than the second left-hand master manipulator and the second right-hand master manipulator.
[0199] 16. The surgical robot system according to item 15, wherein the control device is further configured to:
[0200] In response to an assignment request from a master operator with a higher or same priority for a slave tool assigned to a master operator with a lower or same priority, reassigning the slave tool assigned to the master operator with a lower or same priority to the master operator with a higher or same priority; or
[0201] In response to an assignment request from a lower-priority master operator for a slave tool assigned to a higher-priority master operator, the slave tool assigned to the higher-priority master operator is reassigned to the lower-priority master operator based on the assignment approval.
[0202] 17. According to any one of the surgical robot systems 1 to 16, when mounted on the second operating trolley, the fourth driven tool includes at least one of a laparoscopic system surgical tool, an orthopedic surgical tool, a neurosurgery tool, a puncture surgical tool, an interventional surgical tool, and a transurethral bladder surgical tool.
[0203] Note that the above are only exemplary embodiments of the present disclosure and the technical principles used. Those skilled in the art will understand that the present disclosure is not limited to the specific embodiments herein, and that various obvious changes, readjustments, and substitutions can be made by those skilled in the art without departing from the scope of protection of the present disclosure. Therefore, although the present disclosure has been described in more detail through the above embodiments, the present disclosure is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present disclosure, and the scope of the present disclosure is determined by the scope of the appended claims.
Claims
1. A surgical robot system, characterized in that: include: A plurality of driven tools, the plurality of driven tools comprising at least a first driven tool, a second driven tool, a third driven tool and a fourth driven tool; a plurality of master operators, the plurality of master operators comprising at least a first left-hand master operator, a first right-hand master operator, a second left-hand master operator, and a second right-hand master operator; as well as A control device is connected to the multiple slave tools and the multiple master operators, and is configured to control the slave instrument movements of the first slave tool, the second slave tool, the third slave tool and the fourth slave tool based on the movement of the handles of the first left-hand master operator, the first right-hand master operator, the second left-hand master operator and the second right-hand master operator.
2. The surgical robot system according to claim 1, characterized in that: The control device is also configured as: In response to a preset or assignment request, the first, second, third and fourth slave tools are assigned to the first left-hand master operator, the first right-hand master operator, the second left-hand master operator and the second right-hand master operator, respectively.
3. The surgical robot system according to claim 1 or 2, characterized in that: The control device is also configured to assign a slave instrument of at least one of the multiple slave tools to a handle of at least one of the multiple master operators in response to satisfying an assignment condition, wherein the assignment condition includes that the at least one slave tool is not assigned and / or the at least one master operator has a higher assignment priority.
4. The surgical robot system according to claim 3, characterized in that: The first left-hand master operator and the first right-hand master operator have higher assignment priorities than the second left-hand master operator and the second right-hand master operator.
5. The surgical robot system according to claim 3, characterized in that: The control device is also configured as: In response to an assignment request from a master operator with a higher or same priority to a slave tool assigned to a master operator with a lower or same priority, reallocating the slave tool assigned to the master operator with a lower or same priority to the master operator with a higher or same priority; or In response to an assignment request from a lower priority master operator for a slave tool assigned to a higher priority master operator, the slave tool assigned to the higher priority master operator is reallocated to the lower priority master operator based on the assignment approval.
6. The surgical robot system according to any one of claims 1 to 5, characterized in that: The control device is also configured as: In response to the matching of the handle of at least one master operator among the multiple master operators with the slave instrument of at least one slave tool among the multiple slave tools, a master-slave mapping between the handle of the at least one master operator and the slave instrument of the at least one slave tool is established, and the matching of the handle of the at least one master operator with the slave instrument of the at least one slave tool includes matching the posture of the handle of the at least one master operator with the posture of the slave instrument of the at least one slave tool.
7. The surgical robot system according to claim 6, characterized in that: The control device is also configured as: obtaining an initial posture of a driven tool of the at least one driven tool; obtaining an initial posture of a handle of the at least one master manipulator having an assigned relationship with a slave instrument of the at least one slave tool; Based on the initial posture of the handle of the at least one master operator and the initial posture of the slave instrument of the at least one slave tool, determining whether the handle of the at least one master operator matches the slave instrument of the at least one slave tool; and In response to the handle of the at least one master operator not matching the driven instrument of the at least one slave tool, a master operator control signal is generated, wherein the master operator control signal is used to adjust the posture of the handle of the at least one master operator to match the posture of the driven instrument of the at least one slave tool.
8. The surgical robot system according to claim 6, characterized in that: The master-slave mapping between the handle of the at least one master manipulator and the slave instrument of the at least one slave tool comprises a posture relationship between the handle of the at least one master manipulator and the slave instrument of the at least one slave tool, wherein the posture relationship comprises at least one of the following: The position change of the image of the driven instrument of the at least one driven tool in the display relative to the reference coordinate system is proportional to the position change of the handle of the at least one master operator relative to the reference coordinate system; or The amount of posture change of the image of the driven instrument of the at least one driven tool in the display relative to the reference coordinate system is consistent with the amount of posture change of the handle of the at least one master manipulator relative to the reference coordinate system.
9. The surgical robot system according to claim 8, characterized in that: The control device is also configured as: Obtaining a current position and posture of a handle of the at least one master manipulator; obtaining a previous pose of a handle of the at least one master manipulator; Obtaining a starting position of a driven instrument of the at least one driven tool; Determining a target posture of the slave instrument of the at least one slave tool based on a previous posture of the handle of the at least one master operator, a current posture of the handle of the at least one master operator, a starting posture of the slave instrument of the at least one slave tool, and a posture relationship between the handle of the at least one master operator and the slave instrument of the at least one slave tool; as well as Based on the target posture of the driven tool of the at least one driven tool, a driven tool control signal is generated, wherein the driven tool control signal is used to control the movement of the driven tool of the at least one driven tool.
10. The surgical robot system according to any one of claims 1 to 9, characterized in that: Also includes: Slave visual equipment; as well as A plurality of operating trolleys, used for carrying the plurality of driven tools and the driven visual device, the plurality of operating trolleys at least comprising a first operating trolley and a second operating trolley, The plurality of operating trolleys are configured such that the first operating trolley is used to carry at least the first driven tool, the second driven tool and the third driven tool among the plurality of driven tools and the driven visual device, and the second The operating trolley is used to carry at least the fourth slave tool among the multiple slave tools, or is configured as the first operating trolley is used to carry at least the first slave tool, the second slave tool, the third slave tool and the fourth slave tool among the multiple slave tools, and the second operating trolley is used to carry at least the slave visual device.
11. The surgical robot system according to claim 10, characterized in that: The control device is also configured as: Obtaining the position and posture of the first operating table; Obtaining the position and posture of the second operating table; Determine a transformation relationship between a first operating trolley coordinate system and a second operating trolley coordinate system based on the positions and postures of the first operating trolley and the second operating trolley; as well as Based on the transformation relationship between the first operating trolley coordinate system and the second operating trolley coordinate system, the transformation relationship between the driven tool base coordinate system of the at least one driven tool and the driven vision device base coordinate system is determined.
12. The surgical robot system according to claim 11, characterized in that: The control device is also configured as: Based on the transformation relationship between the slave tool base coordinate system of the at least one slave tool and the slave vision device base coordinate system, the slave instrument of the at least one slave tool is controlled to match the handle of the at least one master operator and / or a master-slave mapping between the slave instrument of the at least one slave tool and the handle of the at least one master operator is established.
13. The surgical robot system according to claim 10, characterized in that: The control device is also configured as: In response to an assignment request of the slave visual device, assigning the slave visual device to a handle of at least one of the plurality of master operators; Establishing a master-slave mapping between a handle of the at least one master operator and the slave visual device; Disconnecting the master-slave mapping between the handles of other master operators among the plurality of master operators and the slave instrument of at least one slave tool among the plurality of slave tools; as well as Based on the handle movement of the at least one master operator, the slave vision device is controlled to move to change the field of view of the slave vision device.
14. The surgical robot system according to claim 13, characterized in that: The control device is also configured as: In response to the master-slave mapping of the slave visual device being disconnected, restoring the assignment relationship between at least one of the plurality of slave tools and at least one of the plurality of master operators; as well as In response to a change in the field of view of the slave visual device, a handle of at least one of the plurality of master manipulators is controlled to match a slave instrument of at least one of the plurality of slave tools having an assigned relationship.
15. The surgical robot system according to claim 10 or 11, characterized in that: The first operating table also includes: The first vehicle body; and a first moving arm, wherein the proximal end of the first moving arm is used for rotationally connecting with the first trolley body, and the distal end is used for carrying at least the first driven tool, the second driven tool, the third driven tool and the fourth driven tool or the driven visual device, The first moving arm comprises: a positioning link mechanism, the proximal end of which is rotatably connected to the first trolley body; and A remote center of motion (RCM) mechanism, wherein the RCM mechanism is configured such that the proximal end can rotate relative to the distal end of the positioning link mechanism, the RCM mechanism comprises a plurality of arcuate arms, the proximal ends and the distal ends of the plurality of arcuate arms are respectively and sequentially rotationally connected, and the rotation axes of the plurality of arcuate arms intersect at the remote center of motion.
16. The surgical robot system according to claim 15, characterized in that: The first vehicle body comprises: Pedestal; A column, arranged on the base; A crossbeam is arranged at the top end of the column, and the distal end of the crossbeam is rotatably connected to the proximal end of the positioning link mechanism. The first operating trolley is configured as follows: the column of the first trolley body includes a column lifting joint for enabling the column to be lifted and lowered relative to the base, or the first motion arm also includes a vertical arm lifting mechanism, the proximal end of the vertical arm lifting mechanism is connected to the distal end of the positioning link mechanism, and the distal end is connected to the proximal end of the RCM mechanism, and the vertical arm lifting mechanism includes a vertical arm and a vertical arm lifting joint for enabling the vertical arm to be lifted and lowered relative to the positioning link mechanism.
17. The surgical robot system according to claim 15, characterized in that: The first motion arm further comprises: A mounting platform, fixedly disposed at a distal end of an arc-shaped arm located at a side away from the positioning link mechanism among the plurality of arc-shaped arms, the mounting platform comprising a plurality of mounting positions; A plurality of linear modules, wherein the plurality of linear modules are respectively arranged on the plurality of installation positions; and A plurality of driving devices are used to drive at least the first driven tool, the second driven tool, the third driven tool and the fourth driven tool or the driven visual device. The plurality of driving devices are respectively mounted on the plurality of linear modules to perform linear motion under the drive of the plurality of linear modules.
18. The surgical robot system according to claim 17, characterized in that: The plurality of driving devices at least include a first driving device, a second driving device, a third driving device and a fourth driving device, which are used to drive the first driven tool, the second driven tool, the third driven tool and the fourth driven tool or the driven visual device respectively. The plurality of linear modules at least include a first linear module, a second linear module, a third linear module and a fourth linear module, which are used to carry the first driving device, the second driving device, the third driving device and the fourth driving device respectively. The multiple mounting positions include at least a first mounting position, a second mounting position, a third mounting position and a fourth mounting position which are arranged at intervals around the center of the mounting platform, and are used to respectively mount the first linear module, the second linear module, the third linear module and the fourth linear module. When the first linear module, the second linear module, the third linear module and the fourth linear module are mounted on the mounting platform, the extension lines of the far ends converge toward the remote motion center.
19. The surgical robot system according to claim 10 or 11, characterized in that: The second operating table also includes: A second vehicle body; and A second moving arm, wherein the proximal end of the second moving arm is used for connecting with the second trolley body, and the distal end is used for carrying at least the fourth driven tool or the driven visual device.
20. According to any one of claims 1 to 19, the fourth slave tool comprises at least one of a laparoscopic system surgery tool, an orthopedic surgery tool, a neurosurgery tool, a puncture surgery tool, an interventional surgery tool, and a transurethral bladder surgery tool.
Citation Information
Patent Citations
Reconfigurable robot architecture for minimally invasive procedures
CN106536134A
Flexible surgical operation robot used for single-hole minimally invasive surgery and using method thereof
CN109431604A
Master-slave motion control method, robot system, equipment and storage medium
CN113876434A
Master-slave motion control method, robot system, equipment and storage medium
CN113876436A
Surgical robot system
CN114376734A
Cited By
Remote multi-master-end cooperative control system and surgical robot system
CN119867948A
Method for controlling surgical robot system based on gestures and surgical robot system
CN120859670A
Master manipulator adjustment control method and device, equipment and medium
CN121359974A
