Control method, device and equipment of surgical robot and medium

The surgical operation tools are initially aligned and positioned through the calibration device, and the positional relationship between the surgical operation tools and the work area is determined using visual acquisition equipment, which solves the risk problem caused by wrong movement during large-scale movement of the surgical robot, and realizes the safety and reliability of the operation Reduced sexual and infection risk.

CN119033468APending Publication Date: 2024-11-29SHANGHAI SURLOGIC ROBOT CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411164773.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-22
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

Existing surgical robots are prone to error movement during large-scale movement, resulting in an increased risk of damage to patients.

Method used

The calibration device is used to perform preliminary alignment and positioning of surgical operation tools, and the image data of the calibration object is obtained by using visual acquisition equipment to determine the relative position relationship between the surgical operation tools and the working area. The surgical operation is made by adjusting the position of the robot arm. The tool moves safely and reliably to the work area.

Benefits of technology

Significantly reduces the risk of surgical robots during large-scale movement, improves the safety and reliability of the surgery, reduces psychological concerns about patients and medical staff, and reduces the risk of infection through sterilized and packaged calibration devices when surgery is suspended .

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119033468A_ABST
    Figure CN119033468A_ABST
Patent Text Reader

Abstract

The invention provides a surgical robot control method, device, equipment and medium, and is applied to a controller of a surgical robot, the surgical robot further comprises a mechanical arm in communication connection with the controller, and the tail end of the mechanical arm carries a surgical operation tool. Controlling the surgical work tool to move to the working area; under the condition that it is detected that the calibration device is moved away from the designated position, the surgical operation tool is controlled to execute the target task for the working area. The risk of the surgical robot can be remarkably reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of robot control technology, and in particular to a control method, device, equipment and medium for a surgical robot. Background Art

[0002] At present, hair transplantation can be done manually, but it is labor-intensive, complicated, and requires strict operation requirements of doctors, which results in a long operation time, requiring both doctors and patients to spend more time and energy. In order to improve the efficiency of hair follicle transplantation, robots can also be used to automatically perform hair transplantation. The hair transplantation robots provided by related technologies have active movement of the robot (mechanical arm), especially in the new generation of hair transplantation surgical robots. Due to the further enhancement of perception performance and planning capabilities, large-scale movement of the robot arm is often included. However, large-scale movement will cause certain risks, such as erroneous movement during large-scale movement, which may cause damage to the patient. Summary of the invention

[0003] In view of this, an object of the present invention is to provide a control method, device, equipment and medium for a surgical robot, which can significantly reduce the risks of the surgical robot.

[0004] In a first aspect, an embodiment of the present invention provides a control method for a surgical robot, the method being applied to a controller of the surgical robot, the surgical robot further comprising a robotic arm communicatively connected to the controller, a surgical tool being carried at the end of the robotic arm, the method comprising:

[0005] Based on the calibration device placed at the designated position, the surgical tool carried by the end of the robotic arm is controlled to move to the working area;

[0006] When it is detected that the marking device is moved away from the designated position, the surgical working tool is controlled to perform a target task on the working area.

[0007] In one embodiment, the surgical robot further includes a visual acquisition device that is communicatively connected to the controller; based on a calibration device placed at a specified position, controlling the surgical tool carried by the end of the robotic arm to move to the working area includes:

[0008] Acquire visual data collected by the visual acquisition device for a calibration device placed at a specified position;

[0009] Preliminarily aligning and positioning the surgical tool based on the visual data to determine a first relative position relationship between the surgical tool and a working area, wherein the designated position is related to a position of the working area;

[0010] The posture of the robot arm is adjusted based on the first relative position relationship so that the surgical tool moves to the working area.

[0011] In one embodiment, the calibration device includes a base and a calibration object, the base is used to fix the calibration object at a specified position, and the visual data includes image data corresponding to the calibration object;

[0012] Preliminarily aligning and positioning the surgical tool based on the visual data to determine a first relative position relationship between the surgical tool and the working area, including:

[0013] Identify the calibration object based on the image data corresponding to the calibration object to obtain an initial calibration object identification result; wherein the initial calibration object identification result includes the position and posture data of the calibration object in the coordinate system of the visual acquisition device;

[0014] Performing coordinate transformation on the initial calibration object recognition result to obtain the target calibration object recognition result; wherein the target calibration object recognition result includes the position and posture data of the calibration object in the robot arm coordinate system;

[0015] According to the position and posture data of the calibration object in the robot arm coordinate system, a first relative position relationship between the surgical operation tool and the working area is determined.

[0016] In one embodiment, the designated position overlaps the working area so that the calibration device obscures the working area;

[0017] Determining a first relative position relationship between the surgical tool and the working area according to the position and posture data of the calibration object in the robot arm coordinate system includes:

[0018] The pose data of the calibration object in the robot arm coordinate system is used as the pose data of the working area in the robot arm coordinate system;

[0019] Based on the position and posture data of the surgical working tool in the robot arm coordinate system and the position and posture data of the working area in the robot arm coordinate system, a first relative position relationship between the surgical working tool and the working area is determined.

[0020] In one embodiment, the method further comprises:

[0021] The calibration device with changed position is tracked through visual acquisition equipment, and the position of the robotic arm is adjusted during the tracking process to guide the surgical tool to complete a specific movement.

[0022] In one embodiment, a calibration device whose position has changed is tracked by a visual acquisition device, and the position of the robot arm is adjusted during the tracking process to guide the surgical tool to complete a specific movement, including:

[0023] Determine, by means of a visual acquisition device, a second relative position relationship between the surgical tool and the current position based on a calibration device placed at the current position, and adjust the posture of the robotic arm based on the second relative position relationship;

[0024] If it is detected that the calibration device moves from the current position to the next position, the position and posture of the visual acquisition device are adjusted;

[0025] Based on the visual acquisition device after adjusting the posture, and based on the calibration device placed at the next position, the new second relative position relationship between the surgical tool and the next position is determined, and the robotic arm posture is continued to be adjusted based on the new second relative position relationship to guide the surgical tool to complete a specific movement.

[0026] In one embodiment, the calibration device is provided with a fixed part or a handheld part, and the outer surface of the calibration device is covered with a sterilization package.

[0027] In one embodiment, the surgical machine is used to achieve the function of extracting hair follicles and / or the function of implanting hair follicles.

[0028] In a second aspect, an embodiment of the present invention further provides a control device for a surgical robot, the device is applied to a controller of the surgical robot, the surgical robot further includes a robotic arm connected to the controller for communication, a surgical tool is mounted at the end of the robotic arm, and the device includes:

[0029] A posture adjustment module, used to control the surgical tool carried by the end of the robotic arm to move to the working area based on a calibration device placed at a specified position;

[0030] The task execution module is used to control the surgical tool to execute the target task on the working area when it is detected that the calibration device is moved away from the designated position.

[0031] In a third aspect, an embodiment of the present invention further provides a surgical robot, comprising:

[0032] Calibration device;

[0033] A controller, and a robotic arm in communication with the controller, wherein a surgical tool is mounted on the end of the robotic arm; wherein:

[0034] The controller is used to control the surgical tool to move to the working area based on a calibration device placed at a designated position, and to control the surgical tool to perform a target task in the working area when it is detected that the calibration device moves away from the designated position.

[0035] In a fourth aspect, an embodiment of the present invention further provides an electronic device, comprising a processor and a memory, wherein the memory stores computer executable instructions that can be executed by the processor, and the processor executes the computer executable instructions to implement any one of the methods provided in the first aspect.

[0036] In a fifth aspect, an embodiment of the present invention further provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement any one of the methods provided in the first aspect.

[0037] A control method, device, equipment and medium of a surgical robot provided in an embodiment of the present invention are applied to a surgical robot. The surgical robot includes a robotic arm, and a surgical tool is carried at the end of the robotic arm. First, based on a calibration device placed at a designated position, the surgical tool carried at the end of the robotic arm is controlled to move to the working area; finally, when it is detected that the calibration device is moved away from the designated position, the surgical tool is controlled to perform a target task for the working area. The above method uses a calibration device to perform preliminary alignment and positioning of the surgical tool, so as to move the surgical tool to the working area on this basis. When the calibration device is moved away from the designated position, the surgical tool can be controlled to perform the target task for the working area. The embodiment of the present invention can conveniently locate the working area by using a calibration device for preliminary alignment and positioning, and then safely and reliably guide the surgical tool to move to the working area, thereby significantly reducing the risks of the surgical robot.

[0038] Other features and advantages of the present invention will be described in the following description, and partly become apparent from the description, or understood by practicing the present invention. The purpose and other advantages of the present invention are realized and obtained by the structures particularly pointed out in the description, claims and drawings.

[0039] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0041] Figure 1 A schematic flow chart of a control method for a surgical robot provided by an embodiment of the present invention;

[0042] Figure 2 A schematic diagram of a calibration device provided by an embodiment of the present invention;

[0043] Figure 3 A schematic structural diagram of a calibration device provided with a fixed hook provided in an embodiment of the present invention;

[0044] Figure 4 A schematic structural diagram of a calibration device provided with an ear-hanging rope provided in an embodiment of the present invention;

[0045] Figure 5 A schematic diagram of the structure of a control device for a surgical robot provided by an embodiment of the present invention;

[0046] Figure 6 A schematic diagram of the structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0047] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution of the present invention will be clearly and completely described in combination with the embodiments below. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0048] At present, existing surgical robots may make erroneous movements during large-scale movement, which may cause damage to patients. Based on this, the present invention provides a control method, device, equipment and medium for a surgical robot, which can significantly reduce the risks of the surgical robot.

[0049] To facilitate understanding of this embodiment, a control method for a surgical robot disclosed in an embodiment of the present invention is first described in detail. The method is applied to a surgical robot, which is used to achieve the function of extracting hair follicles and / or planting hair follicles. The surgical robot includes a robotic arm, and a surgical tool is mounted at the end of the robotic arm. Figure 1 The flowchart of a control method of a surgical robot is shown in FIG. 1 , and the method mainly includes the following steps S102 to S104:

[0050] Step S102, based on the calibration device placed at the designated position, controlling the surgical tool carried by the end of the robot arm to move to the working area.

[0051] In one example, visual data collected by a visual acquisition device at a calibration device placed at a designated position is obtained, and the surgical tool is preliminarily aligned and positioned based on the visual data to determine a first relative position relationship between the surgical tool and the working area, wherein the designated position is related to the position of the working area; and then the position of the robotic arm is adjusted based on the first relative position relationship to move the surgical tool to the working area.

[0052] Optionally, the surgical robot may further include a visual acquisition device. The visual acquisition device may be a device with the function of acquiring images or videos, such as a camera, etc. The visual data may be image data, and the content displayed by the image data includes the calibration object in the calibration device. In one example, the visual acquisition device is used to acquire the calibration data of the calibration device placed at the specified position to obtain the corresponding visual data. The specified position here may be a position overlapping with the working area, or a fixed position outside the working area, and the working area is also the operating area; then, the position information of the calibration device in the robot arm coordinate system is identified based on the visual data, and the position information is converted into a first relative position relationship between the working area and the surgical tool at the end of the robot arm.

[0053] In another example, the surgical robot may also include a force sensor for sensing the force conditions when the end of the robotic arm contacts the calibration device, thereby identifying the position information of the calibration device in the robotic arm coordinate system according to the force conditions, and converting the position information into a first relative position relationship between the working area and the surgical working tool at the end of the robotic arm.

[0054] Furthermore, the kinematic model of the robotic arm can be used to determine the joint angle of the robotic arm based on the aforementioned first relative position relationship, and then the posture of the robotic arm can be adjusted according to the joint angle to move the surgical tool to the working area.

[0055] Step S104, when it is detected that the calibration device is moved away from the designated position, the surgical operation tool is controlled to perform the target task in the working area.

[0056] The target task may be a real-time positioning task based on image data (such as hair follicle images) at the working area, or a hair removal and / or hair transplantation task. In one example, the image data at the designated position may be collected in real time by a visual acquisition device, and when the calibration device moves out of the acquisition range of the visual acquisition device, it can be determined that the calibration device has moved away from the designated position, and then the perception performance and planning ability of the surgical robot are used to control the surgical tool to perform the target task for the working area.

[0057] The control method of the above-mentioned surgical robot provided by the embodiment of the present invention uses a calibration device to perform preliminary alignment and positioning of the surgical working tools, so as to move the surgical working tools to the working area on this basis. When the calibration device is moved away from the designated position, the surgical working tools can be controlled to perform the target task with respect to the working area. The embodiment of the present invention uses the calibration device to perform preliminary alignment and positioning, so as to conveniently locate the working area, and then safely and reliably guide the surgical working tools to move to the working area, thereby significantly reducing the risks of the surgical robot.

[0058] In one example, the aforementioned surgical robot may be a hair transplant (hair transplant) surgical robot, and the surgical tool carried by it may be a hair transplant tool. In practical applications, existing hair transplant surgical robots often include a tensioner, for example, a frame structure is fixed to the target area by bundling or nailing to play a tensioning role, that is, to increase the hardness of the target area. In some embodiments, markers such as QR codes can be pasted on the tensioner to assist in preoperative alignment. However, considering that the tensioner is mainly used during surgery, its design and use are mainly to meet the tensioning purpose during hair transplant surgery, and cannot meet the preoperative protection, calibration and measurement purposes to the greatest extent. In addition, the process of wearing the tensioner is relatively cumbersome, which also limits the feasibility of the tensioner in terms of functional diversity to a certain extent. In addition, the tensioner is also unable to achieve the function of ensuring safety and guiding functions.

[0059] Based on this, the present invention first explains the calibration device. The calibration device can also be called an alignment plate. The calibration device can have various forms, such as Figure 2 A schematic diagram of a calibration device is shown, the basic structure of which includes a base that can be fixed or handheld, and a calibration object. The base is used to fix the calibration object at a specified position, and the calibration object can be a QR code or other forms of markers.

[0060] In one example, a fixing component is provided on the base. In order to adapt to different usage scenarios, the structural components can also be improved. For example, if necessary, the calibration device can be fixed on the tensioner, and a fixing hook can be designed on the base of the calibration device, such as Figure 3 The structure diagram of a calibration device provided with a fixed hook is shown in FIG. 1 , so as to hang it during the alignment process. For another example, at least two ear-hanging ropes may be provided on the base of the calibration device. For example, four ear-hanging ropes are provided. Figure 4 The schematic diagram of the structure of a calibration device provided with ear-hanging ropes is shown, and the calibration device is fixed on the two ears of the patient using four ear-hanging ropes. It should be noted that the calibration device provided in the embodiment of the present invention does not limit the tensioner required to be used in conjunction, and can be simply modified for different tensioner forms.

[0061] In one example, a handheld component is provided on the base. In practical applications, if a handheld calibration device is required, a handle can also be installed on the calibration device. It should be noted that the calibration object and the working area do not need to overlap, and only need to have a fixed relative position relationship.

[0062] In some scenarios, in order to adapt to the position of the camera, the calibration device can also be modified accordingly so that it can appear more easily in the camera's field of view. Exemplarily, the fixing method between the base and the calibration object is modified so that the angle between the base and the calibration object can be adjusted. By adjusting the angle between the base and the calibration object, the calibration object is made to face the camera directly, so that the calibration object can appear more easily in the camera's field of view.

[0063] In one example, the outer surface of the calibration device is covered with a sterile package for easy use during surgery. In actual work scenarios, it often involves situations where medical staff need to suspend surgery, such as transferring the patient to another operating room, or other circumstances causing the surgery to be suspended. At this time, in order to reduce the risk of infection and continue the surgery after the surgery is suspended, a calibration device covered with a sterile package can be used to protect the target area, that is, to reduce the risk of infection.

[0064] Based on the above calibration device, an embodiment of the present invention provides an application example of a control method for a surgical robot, including the following steps 1 to 3:

[0065] Step 1: Place the calibration device on the working area. Taking the use scenario of the hair transplant surgery robot as an example, first fix the patient in the surgical position, then fix the tensioner, and then fix the calibration device and the tensioner to each other.

[0066] Step 2, use the camera to face the alignment plate, and use the camera to identify the calibration object on the calibration device; based on the recognition results, especially the position of the calibration object, the position of the surgical working tool (such as a hair transplant needle) at the end of the robotic arm can be calculated, as well as the first relative position relationship between the surgical working tool and the working area.

[0067] In a specific implementation, the first relative position relationship between the surgical tool and the working area may be determined according to the following steps 2.1 to 2.3:

[0068] Step 2.1, recognize the calibration object based on the image data corresponding to the calibration object to obtain an initial calibration object recognition result, wherein the initial calibration object recognition result includes the position and posture data of the calibration object in the coordinate system of the visual acquisition device.

[0069] Here, taking a positioning code in the form of a two-dimensional code as an example, a specific implementation method of identifying a calibration object is provided, including:

[0070] (2.1.1) Image acquisition: First, an image containing a QR code needs to be acquired, usually through a camera or other image capture device.

[0071] (2.1.2) Image preprocessing: In order to improve the accuracy and efficiency of recognition, image preprocessing is a necessary step. It includes: (a) Grayscale conversion: Convert the color image to grayscale to simplify subsequent processing. (b) Binarization: Convert the image to black and white through threshold processing to facilitate the recognition of the black and white modules of the QR code. (c) Noise reduction: Remove noise from the image, such as using median filtering, Gaussian filtering, etc.

[0072] (2.1.3) Locating QR codes: QR codes have specific locating patterns, which are three large square marks at the three corners of the QR code (upper left, upper right, and lower left). Identifying these locating patterns is the key to finding the QR code area. These include: (a) Edge detection: For example, using the Sobel operator or Canny edge detection to find the boundaries in the image. (b) Shape detection: Detecting locating patterns, usually by looking for squares of a specific size and proportion.

[0073] (2.1.4) QR code correction: Due to the shooting angle or perspective distortion, the QR code may be distorted. The correction step includes perspective transformation: the perspective distortion is estimated based on the three positioning patterns of the QR code, and then the inverse perspective transformation is applied to correct the image.

[0074] (2.1.5) Decoding: Decoding the corrected image into data. Includes: (a) Data block recognition: Analyze the small blocks (modules) inside the QR code and identify the data and error correction code according to the predetermined format. (b) Error correction processing: The QR code usually contains error correction data, using, for example, the Reed-Solomon error correction algorithm to correct erroneous or damaged data.

[0075] (2.1.6) Data parsing: Convert the decoded data into a format that the user can understand.

[0076] In the current scenario, in fact, it is only necessary to identify the position of the QR code, so the above steps can be simplified, for example, error correction and decoding processing are not performed. According to the result of locating the QR code, the position of the QR code in the camera coordinate system (that is, the coordinate system of the aforementioned visual acquisition device) can be calculated, and then the relative position relationship between it and the end of the robot arm (and other key structures) can be calculated.

[0077] Step 2.2, coordinate conversion is performed on the initial calibration object recognition result to obtain the target calibration object recognition result. The target calibration object recognition result includes the position and posture data of the calibration object in the robot arm coordinate system.

[0078] In the specific implementation, according to the initial calibration object recognition result, the QR code pose in the current camera coordinate system can be obtained, which is recorded as For other key structures, we only take the end of the robot arm as an example and assume that the relative position relationship between it and the camera is known, which is recorded as Then the position and posture of the QR code in the coordinate system of the end of the robot arm can be calculated, which is recorded as

[0079] Step 2.3, determining the first relative position relationship between the surgical tool and the working area according to the position and posture data of the calibration object in the robot arm coordinate system.

[0080] In one example, the designated position overlaps with the working area, so that the calibration device blocks the working area. Considering that the large-scale movement of the hair transplant surgery robot will cause certain psychological concerns to patients and medical staff. Since medical robots have only been around for a short time and have not been widely popularized, medical staff will have certain concerns about the safety of medical robots. Therefore, adding additional calibration devices to block the working area and provide protection for the working area can effectively alleviate the above problems at this stage.

[0081] On this basis, the posture data of the calibration object in the robotic arm coordinate system can be used as the posture data of the working area in the robotic arm coordinate system; based on the posture data of the surgical working tool in the robotic arm coordinate system and the posture data of the working area in the robotic arm coordinate system, the first relative position relationship between the surgical working tool and the working area can be determined.

[0082] Step 3, further guiding the robot arm to complete specific movements, such as aligning the work area.

[0083] Assume that the end of the robot arm needs to be moved to the position of the QR code. In this way, the joint angles of the robot arm can be calculated based on the kinematic model of the robot arm, and then the robot arm can be controlled to complete a specific movement.

[0084] It should be noted that in actual application scenarios, the end of the robotic arm is usually not moved directly to the position of the QR code. Instead, the target position of the end of the robotic arm is calculated based on the position of the QR code, and the joint angles of the robotic arm are calculated based on the kinematic model of the robotic arm to facilitate the control of the robotic arm to complete a specific movement.

[0085] In some cases, the alignment plate can be handheld instead of fixed to the work area to guide the robot to complete specific movements, such as following. In one example, it is necessary to track the calibration device whose position has changed through a visual acquisition device, and adjust the robot arm posture during the tracking process to guide the surgical tool to complete a specific movement. In the specific implementation, please refer to the following steps 1 to 3:

[0086] Step 1: Determine the second relative position relationship between the surgical tool and the current position through the visual acquisition device based on the calibration device placed at the current position, and adjust the robot arm posture based on the second relative position relationship. In the specific implementation, please refer to the above steps 2 to 3, which will not be described in detail in the embodiment of the present invention.

[0087] Step 2: If it is detected that the calibration device moves from the current position to the next position, adjust the posture of the visual acquisition device. In one example, the distance between the current position and the next position should be less than a preset distance threshold, which is related to the acquisition range of the camera to ensure that when the calibration device moves from the current position to the next position, the calibration device is still partially or completely within the acquisition range of the camera. The camera is adjusted to face the calibration device, and step 3 is performed on this basis.

[0088] Step three, based on the visual acquisition device after adjusting the posture, and based on the calibration device placed at the next position, determine the new second relative position relationship between the surgical tool and the next position, and continue to adjust the robot arm posture based on the new second relative position relationship to guide the surgical tool to complete a specific movement.

[0089] In summary, the control method of the hair transplant surgery robot provided in the embodiment of the present invention is mainly used to provide a convenient way of aligning and positioning the surgical area before the start of hair harvesting and / or transplantation surgery, or between different stages of the surgery. The embodiment of the present invention has at least the following characteristics:

[0090] (1) Positioning the working area: By identifying the calibration object on the calibration device, the working area can be easily positioned, thereby guiding the robot arm to complete a specific movement, such as aligning the surgical area. The alignment process is to place the end tool of the robot arm (such as a hair transplant needle) in the correct position to facilitate subsequent hair transplant operations.

[0091] (2) Ensure safety: Hair transplant surgery robots involve active movement of the robot (robotic arm), especially in the new generation of hair transplant surgery robots. Due to the further enhancement of perception performance and planning capabilities, the robot arm often moves over a large range. For example, in many hair transplant surgery robot usage scenarios, it is often necessary to first move the robot to a certain range (e.g. 1 cm) from the working area (patient's head) before the robot can operate on its own and complete the hair removal or transplantation task. The large-scale movement of the robotic arm during this process will cause certain risks, as shown in:

[0092] a. The precision required by the hair transplant surgery robot is very high, but this precision will be affected to a certain extent by the single movement stroke of the robot arm, and when moving over a large range, erroneous movement may occur, which may then cause damage to the patient. The embodiment of the present invention can safely and reliably guide the surgical tool to move to the working area by performing preliminary alignment and calibration on the surgical tool, so as to avoid erroneous movement during large-scale movement.

[0093] b. The large-scale movement of the hair transplant surgery robot will cause certain psychological concerns for patients and medical staff. Since medical robots have only been around for a short time and have not been widely popularized, medical staff will have certain concerns about the safety of medical robots. Therefore, the calibration device is used to block the working area and provide protection for the working area. The calibration device can effectively alleviate this problem at this stage.

[0094] c. Pause of surgery. In actual working scenarios, medical staff often need to suspend the operation, such as transferring the patient to another operating room, or other situations causing the suspension of the operation. At this time, in order to reduce the risk of infection and continue the operation after the suspension, the calibration device provided in the embodiment of the present invention can be used to protect the working area, such as using a calibration device covered with a sterilized package to cover the working area to reduce the risk of infection.

[0095] (3) Guidance function: By identifying the calibration objects on the alignment plate, the surgical robot can be easily guided to complete specific movements, such as guiding or following movements. This can simplify some operating procedures of the surgical robot, especially specific robot arm movement operations.

[0096] Furthermore, the calibration device can be sterilized and used during surgery. Such a design can effectively reduce the risk of infection during surgery.

[0097] Based on the above embodiments, an embodiment of the present invention provides a control device for a surgical robot, which is applied to a controller of the surgical robot. The surgical robot also includes a mechanical arm connected to the controller for communication, and a surgical tool is mounted at the end of the mechanical arm. Figure 5 The schematic diagram of the structure of a control device of a surgical robot is shown, and the device mainly includes the following parts:

[0098] The posture adjustment module 502 is used to control the surgical tool carried by the end of the robot arm to move to the working area based on the calibration device placed at the designated position;

[0099] The task execution module 504 is used to control the surgical tool to execute the target task in the working area when it is detected that the calibration device is moved away from the designated position.

[0100] The control device of the above-mentioned surgical robot provided by the embodiment of the present invention uses a calibration device to perform preliminary alignment and positioning of the surgical working tools, so as to move the surgical working tools to the working area on this basis. When the calibration device is moved away from the designated position, the surgical working tools can be controlled to perform the target task in the working area. The embodiment of the present invention uses the calibration device to perform preliminary alignment and positioning, so as to conveniently locate the working area, and then safely and reliably guide the surgical working tools to move to the working area, thereby significantly reducing the risks of the surgical robot.

[0101] In one embodiment, the surgical robot further includes a visual acquisition device in communication with the controller; the posture adjustment module 502 is further used for:

[0102] Acquire visual data collected by a visual acquisition device for a calibration device placed at a specified position;

[0103] Preliminarily aligning and positioning the surgical tool based on the visual data to determine a first relative position relationship between the surgical tool and the working area, wherein the designated position is related to the position of the working area;

[0104] Based on the first relative position relationship, the robot arm posture is adjusted to move the surgical tool to the working area.

[0105] In one embodiment, the calibration device includes a base and a calibration object, the base is used to fix the calibration object at a specified position, and the visual data includes image data corresponding to the calibration object; the posture adjustment module 502 is used to:

[0106] Identify the calibration object based on the image data corresponding to the calibration object to obtain an initial calibration object identification result; wherein the initial calibration object identification result includes the position and posture data of the calibration object in the coordinate system of the visual acquisition device;

[0107] Performing coordinate transformation on the initial calibration object recognition result to obtain the target calibration object recognition result; wherein the target calibration object recognition result includes the position and posture data of the calibration object in the robot arm coordinate system;

[0108] According to the position and posture data of the calibration object in the robot arm coordinate system, a first relative position relationship between the surgical operation tool and the working area is determined.

[0109] In one implementation, the designated position overlaps with the working area so that the calibration device covers the working area; the posture adjustment module 502 is used to:

[0110] The pose data of the calibration object in the robot arm coordinate system is used as the pose data of the working area in the robot arm coordinate system;

[0111] Based on the position and posture data of the surgical working tool in the robot arm coordinate system and the position and posture data of the working area in the robot arm coordinate system, a first relative position relationship between the surgical working tool and the working area is determined.

[0112] In one embodiment, a tracking module is further included, which is used to:

[0113] The calibration device with changed position is tracked through visual acquisition equipment, and the position of the robotic arm is adjusted during the tracking process to guide the surgical tool to complete a specific movement.

[0114] In one embodiment, the tracking module is used to:

[0115] Determine, by means of a visual acquisition device, a second relative position relationship between the surgical tool and the current position based on a calibration device placed at the current position, and adjust the posture of the robotic arm based on the second relative position relationship;

[0116] If it is detected that the calibration device moves from the current position to the next position, the position and posture of the visual acquisition device are adjusted;

[0117] Based on the visual acquisition device after adjusting the posture, and based on the calibration device placed at the next position, the new second relative position relationship between the surgical tool and the next position is determined, and the robotic arm posture is continued to be adjusted based on the new second relative position relationship to guide the surgical tool to complete a specific movement.

[0118] In one embodiment, the calibration device is provided with a fixed part or a handheld part, and the outer surface of the calibration device is covered with a sterilization package.

[0119] In one embodiment, the surgical machine is used to achieve the function of extracting hair follicles and / or the function of implanting hair follicles.

[0120] The device provided in the embodiment of the present invention has the same implementation principle and technical effects as those of the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference may be made to the corresponding contents in the aforementioned method embodiment.

[0121] On the basis of the above-mentioned embodiments, an embodiment of the present invention provides a surgical robot, comprising:

[0122] Calibration device;

[0123] A controller, and a robotic arm in communication with the controller, wherein a surgical tool is mounted on the end of the robotic arm; wherein:

[0124] The controller is used to control the surgical tool to move to the working area based on a calibration device placed at a designated position, and to control the surgical tool to perform a target task in the working area when it is detected that the calibration device moves away from the designated position.

[0125] The surgical robot provided in the embodiment of the present invention has the same implementation principle and technical effects as those in the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the surgical robot embodiment, reference may be made to the corresponding contents in the aforementioned method embodiment.

[0126] An embodiment of the present invention provides an electronic device. Specifically, the electronic device includes a processor and a storage device. The storage device stores a computer program, and when the computer program is executed by the processor, it executes the method described in any one of the above-mentioned implementation methods.

[0127] Figure 6 A structural diagram of an electronic device provided in an embodiment of the present invention, the electronic device 100 includes: a processor 60, a memory 61, a bus 62 and a communication interface 63, wherein the processor 60, the communication interface 63 and the memory 61 are connected via the bus 62; the processor 60 is used to execute an executable module stored in the memory 61, such as a computer program.

[0128] The memory 61 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk memory. The communication connection between the system network element and at least one other network element is realized through at least one communication interface 63 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used.

[0129] The bus 62 may be an ISA bus, a PCI bus, or an EISA bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 6 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0130] Among them, the memory 61 is used to store programs, and the processor 60 executes the program after receiving the execution instruction. The method executed by the device for flow process definition disclosed in any embodiment of the above-mentioned embodiment of the present invention can be applied to the processor 60 or implemented by the processor 60.

[0131] The processor 60 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 60. The above processor 60 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in the embodiments of the present invention can be directly embodied as a hardware decoding processor to be executed, or the hardware and software modules in the decoding processor can be executed. The software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 61, and the processor 60 reads the information in the memory 61 and completes the steps of the above method in combination with its hardware.

[0132] The computer program product of the readable storage medium provided in the embodiment of the present invention includes a computer-readable storage medium storing program code, and the instructions included in the program code can be used to execute the methods described in the previous method embodiments. The specific implementation can be referred to the previous method embodiments, which will not be repeated here.

[0133] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc., which can store program codes.

[0134] Finally, it should be noted that the above-described embodiments are only specific implementations of the present invention, which are used to illustrate the technical solutions of the present invention, rather than to limit them. The protection scope of the present invention is not limited thereto. Although the present invention is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed by the present invention, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A control method for a surgical robot, characterized in that: The method is applied to a controller of a surgical robot, wherein the surgical robot further comprises a mechanical arm communicatively connected to the controller, and a surgical tool is mounted at the end of the mechanical arm. The method comprises: Based on the calibration device placed at the designated position, control the surgical tool carried by the end of the robotic arm to move to the working area; When it is detected that the marking device is moved away from the designated position, the surgical working tool is controlled to perform a target task on the working area.

2. The control method of the surgical robot according to claim 1, characterized in that: The surgical robot further comprises a visual acquisition device communicatively connected to the controller; Based on the calibration device placed at the designated position, controlling the surgical tool carried by the end of the robotic arm to move to the working area includes: Acquire visual data collected by the visual acquisition device for a calibration device placed at a specified position; Preliminarily aligning and positioning the surgical tool based on the visual data to determine a first relative position relationship between the surgical tool and a working area, wherein the designated position is related to a position of the working area; The posture of the robot arm is adjusted based on the first relative position relationship so that the surgical tool moves to the working area.

3. The control method of the surgical robot according to claim 2, characterized in that: The calibration device comprises a base and a calibration object, wherein the base is used to fix the calibration object at the specified position, and the visual data comprises image data corresponding to the calibration object; Preliminarily aligning and positioning the surgical tool based on the visual data to determine a first relative position relationship between the surgical tool and the working area includes: Identify the calibration object based on the image data corresponding to the calibration object to obtain an initial calibration object identification result; wherein the initial calibration object identification result includes the position and posture data of the calibration object in the coordinate system of the visual acquisition device; Performing coordinate transformation on the initial calibration object recognition result to obtain a target calibration object recognition result; wherein the target calibration object recognition result includes the position and posture data of the calibration object in the robot arm coordinate system; According to the posture data of the calibration object in the robot arm coordinate system, a first relative position relationship between the surgical operation tool and the working area is determined.

4. The control method of the surgical robot according to claim 3, characterized in that: The designated position overlaps with the working area so that the calibration device covers the working area; Determining a first relative position relationship between the surgical tool and the working area according to the position and posture data of the calibration object in the robot arm coordinate system includes: The pose data of the calibration object in the robot arm coordinate system is used as the pose data of the working area in the robot arm coordinate system; Based on the position and posture data of the surgical working tool in the robot arm coordinate system and the position and posture data of the working area in the robot arm coordinate system, a first relative position relationship between the surgical working tool and the working area is determined.

5. The control method of the surgical robot according to claim 2, characterized in that: The method further comprises: The calibration device whose position has changed is tracked by the visual acquisition device, and the posture of the robot arm is adjusted during the tracking process to guide the surgical tool to complete a specific movement.

6. The control method of the surgical robot according to claim 5, characterized in that: Tracking the calibration device whose position has changed by the visual acquisition device, and adjusting the posture of the robot arm during the tracking process to guide the surgical tool to complete a specific movement, including: Determine, by means of the visual acquisition device, a second relative position relationship between the surgical tool and the current position based on the calibration device placed at the current position, and adjust the posture of the robotic arm based on the second relative position relationship; If it is detected that the calibration device moves from the current position to the next position, adjusting the position and posture of the visual acquisition device; Based on the visual acquisition device after adjusting the posture, and based on the calibration device placed at the next position, a new second relative position relationship between the surgical tool and the next position is determined, and based on the new second relative position relationship, the posture of the robotic arm is continued to be adjusted to guide the surgical tool to complete a specific movement.

7. The control method of the surgical robot according to claim 1, characterized in that: The calibration device is provided with a fixed component or a handheld component; The outer surface of the calibration device is covered with a sterilization package.

8. The control method of the surgical robot according to claim 1, characterized in that: The surgical machine is used to realize the function of extracting hair follicles and / or the function of planting hair follicles.

9. A control device for a surgical robot, characterized in that: The device is applied to a controller of a surgical robot, the surgical robot further comprising a mechanical arm connected to the controller in communication, the end of the mechanical arm being equipped with a surgical tool, and the device comprising: A posture adjustment module, used for controlling the surgical tool carried by the end of the robotic arm to move to the working area based on a calibration device placed at a designated position; The task execution module is used to control the surgical tool to execute the target task for the working area when it is detected that the marking device is moved away from the designated position.

10. A surgical robot, characterized in that: include: Calibration device; A controller, and a robotic arm in communication with the controller, wherein a surgical tool is mounted on the end of the robotic arm; wherein: The controller is used to control the surgical tool to move to the working area based on the calibration device placed at the designated position, and control the surgical tool to perform a target task on the working area when it is detected that the calibration device is moved away from the designated position.

11. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores computer executable instructions that can be executed by the processor, and the processor executes the computer executable instructions to implement the method according to any one of claims 1 to 8.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are called and executed by a processor, the computer-executable instructions prompt the processor to implement the method according to any one of claims 1 to 8.