Tracer orientation positioning method, device, electronic equipment and medium
By using a double-sided tracer and an optimal orientation algorithm in medical surgery, the problem of the tracer being masked in complex scenarios is solved, which reduces structural complexity and cost, and improves the accuracy and fluency of surgical positioning.
Patent Information
- Application Number
- CN202311810377.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-26
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2043-12-26
AI Technical Summary
In existing medical surgical scenarios, the limitations of the tracer's trace structure make it easy to be obscured in complex scenarios and difficult to be captured by the camera. The existing solutions increase the structural complexity and cost by increasing the number of tracers, and affect the operation. .
Using a double-sided tracer, and the optimal orientation of the tracer in the tracking system coordinate system is determined through algorithms, so that it can be clearly captured by the camera in any position, reducing structural complexity and cost, improving accuracy and smoothness sex.
Through the double-sided tracer and optimal orientation algorithm, the tracer is always visible, reducing the complexity of the end structure of the robot arm, improving the accuracy of surgical positioning and operating fluency, and reducing the impact of errors.
Smart Images

Figure CN117770958B_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of robot control and relates to a tracer orientation positioning method, device, electronic equipment and medium. Background Art
[0002] In existing medical surgery scenarios, navigation robots are mainly used to assist doctors in their operations. The robot moves the locator to a specific position to facilitate the support and positioning of the doctor's operating tools. In order to ensure that the robot moves accurately to a specific position, a tracer needs to be installed at the end of the robot to determine the end position through a camera.
[0003] Due to the complexity and variety of surgical operation scenarios, and the limitations of the tracer structure, a single tracer is easily obscured in many scenarios, making it difficult for the camera to capture the tracer. To solve this problem, the existing solution is basically to set as many tracers as possible on the robot. However, such a setting increases the structural complexity of the robot terminal, increases a lot of costs and errors between components. At the same time, too many tracers take up too much space and affect the doctor's operation. Summary of the invention
[0004] In order to overcome the deficiencies of the prior art, the present invention provides a tracer orientation positioning method, device, electronic equipment and medium.
[0005] In order to achieve the above object, the present invention adopts the following technical solutions:
[0006] A tracer orientation positioning method comprises the following steps:
[0007] S1. determining a first positional relationship between the camera and one end of the implant according to positions of the implant and the camera in a tracking system coordinate system;
[0008] S2. Determine the optimal orientation of the tracer in the tracking system coordinate system according to the orientation of the implant and the first positional relationship.
[0009] The optimal orientation is the direction in which the angle formed by the normal of the tracer plane relative to the vector of the first positional relationship is the smallest when the axis of the locator channel coincides with the axis of the implant.
[0010] Furthermore, in step S1, the position of the camera is set as the origin of the tracking system coordinate system to obtain a first position relationship of a vector of one end of the implant relative to the camera.
[0011] Furthermore, in step S2, the specific steps of determining the optimal orientation of the tracer in the tracking system coordinate system include:
[0012] S2.1, obtaining a unit vector according to the direction of the implant;
[0013] S2.2. according to the vector relationship between the unit vector and the first position relationship, solving the projection relationship vector of the vector of the first position relationship in the direction of the unit vector;
[0014] S2.3. Obtain an optimal orientation vector of the tracer according to the vector relationship between the first position relationship and the projection relationship.
[0015] Furthermore, in step S2, when the tracer is in the optimal orientation in the tracking system coordinate system, the normal of the tracer plane is located in the plane formed by the vector of the first positional relationship and the axis of the implant.
[0016] Further, in step S2, in step S2, when the tracer is in the optimal orientation in the tracking system coordinate system, the normal of the tracer plane coincides with the optimal orientation vector.
[0017] Furthermore, the tracer is a double-sided tracer, comprising two tracing planes. In step S2, the optimal orientation is the direction in which the angle formed by the normal on any of the tracing planes relative to the vector of the first position relationship is the smallest.
[0018] A surgical navigation positioning device includes a determination module, wherein the determination module is used to:
[0019] Determining a first positional relationship between the camera and one end of the implant based on positions of the implant and the camera in a tracking system coordinate system;
[0020] According to the direction of the implant and in combination with the first positional relationship, the optimal orientation of the double-sided tracer in the tracking system coordinate system is determined.
[0021] Furthermore, the determining module is also used for:
[0022] Obtain a unit vector based on the orientation of the implant;
[0023] According to the vector relationship between the unit vector and the first position relationship, solving the projection relationship of the first position relationship vector in the direction of the unit vector;
[0024] According to the vector relationship between the first position relationship and the projection relationship, an optimal orientation vector of the tracer is obtained.
[0025] An electronic device comprises a processor and a memory, wherein the memory stores computer executable instructions, and the instructions are used to implement the above-mentioned tracer orientation positioning method when executed by the processor.
[0026] A readable storage medium, characterized in that it stores a computer program, and when the computer program is executed on a processor, the above-mentioned tracer orientation positioning method is implemented.
[0027] In summary, the present invention is beneficial in that:
[0028] The present invention sets a double-sided tracer, which is equivalent to forming tracer surfaces on both sides of the robot arm, so that the double-sided tracer is difficult to be completely blocked in any complex posture of the robot arm; further, by combining the positional relationship between the implant and the camera, an algorithm is formed that can calculate the optimal orientation of any side of the double-sided tracer, and cooperates with the robot arm control, so that in any complex posture, one of the tracer surfaces can be fully and clearly captured by the camera, ensuring that the tracer is visible at any time; a good visual effect is formed by the double-sided tracer, which greatly reduces the structural complexity of the robot terminal and improves fluency, safety and accuracy. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] Figure 1 It is a structural schematic diagram of a surgical navigation and positioning system of the present invention.
[0030] Figure 2 The present invention is a flowchart of a tracer orientation positioning method.
[0031] Figure 3 A flowchart of a method for determining the optimal orientation of a tracer in a tracking system coordinate system in the present invention.
[0032] Figure 4 It is a schematic diagram of the structure of a double-sided tracer in the present invention.
[0033] Figure 5 It is a schematic structural diagram of another double-sided tracer in the present invention.
[0034] Figure 6 Schematic diagram of the position coordinate relationship between the implant and the camera in the present invention. DETAILED DESCRIPTION
[0035] The following describes the embodiments of the present invention by specific examples, and those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.
[0036] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.
[0037] All directional indications in the embodiments of the present invention (such as up, down, left, right, front, back, horizontal, vertical...) are only used to explain the relative position relationship, movement status, etc. between the components in a certain specific posture. If the specific posture changes, the directional indication will also change accordingly.
[0038] This embodiment discloses a surgical navigation and positioning system. Figure 1 , including a three-dimensional navigation and tracking system, a robotic arm 102, a locator 103, a C-arm machine 105, a host computer 101, a patient tracer and a positioning tracer.
[0039] The robot arm 102 includes a base and an end, and a plurality of movable joints are provided between the base and the end. The base of the robot arm 102 is installed on a trolley.
[0040] The host computer 101 is in communication connection with the robot arm 102 , and the host computer 101 can obtain the real-time coordinate conversion relationship between the base coordinate system and the end coordinate system of the robot arm 102 in real time, and execute the tracer orientation positioning method provided below in this embodiment.
[0041] The three-dimensional navigation and tracking system can be a three-dimensional navigation system based on physical principles, such as an infrared optical navigation system, a visible light optical navigation system, a magnetic navigation system, and an electric navigation system; the three-dimensional navigation and tracking system is communicatively connected to the host computer 101.
[0042] The C-arm machine 105 is used to scan a patient, for example, to scan an X-ray image or a computed tomography (CT) image.
[0043] The patient tracer is installed near the patient's lesion to characterize the patient's position. The patient tracer can be captured by the three-dimensional navigation and tracking system to track the patient's position.
[0044] The positioner 103 is installed at the end of the mechanical arm 102. Figure 4 A channel 201 is provided at the front end of the locator 103 , and the channel 201 is a guide channel 201 for the implant to enter during surgery. Medical surgical instruments can enter the patient's lesion through the channel 201 , and the rear end of the locator 103 is fixedly connected to the end of the robotic arm 102 .
[0045] The position of the implant may be a screw insertion position in orthopedic surgery, a prosthesis placement position, an ablation lesion position in puncture surgery, or a biopsy position, etc., which are lesion positions in the medical field.
[0046] The three-dimensional navigation and tracking system in this embodiment is preferably an optical navigation system, including a camera 104 .
[0047] The locator 103 is equipped with a positioning tracer, which can be captured by the three-dimensional navigation tracking system in real time to determine the position and posture of the locator 103; in this embodiment, the positioning tracer is configured as a double-sided tracer, including two brackets 202 respectively arranged on both sides of the channel 201, preferably symmetrically arranged with the channel 201 as the center, each of the brackets 202 is provided with four reflective balls 203 that can be captured and identified by the camera 104, and the normal direction on the tracing plane formed by the coplanarity of the four reflective balls 203 is the orientation of the tracer on this surface.
[0048] This embodiment adopts a double-sided tracer, which greatly reduces the structural complexity of the end of the robot 102 compared to the traditional five-sided, three-sided or other multi-sided tracer settings, not only reducing the cost, but also effectively reducing the impact of errors such as process and installation, and improving accuracy; compared to the single-sided tracer, the double-sided is equivalent to installing tracers on both sides of the end of the robot 102, so that the robot 102 can be in any posture, especially in complex postures such as pelvic fracture surgery. The double-sided setting makes it impossible for the tracer to be completely blocked, and one of them will always be tracked by the camera 104, which can be applicable to more types of surgeries, and also improves the accuracy of surgical positioning and the smoothness of surgical operations.
[0049] Based on the surgical navigation positioning system provided above, in order to place the positioning tracer in an optimal visible position each time the locator moves into position so that it can be accurately tracked by the camera, this embodiment further provides a tracer orientation positioning method, which can determine the optimal orientation of the tracer each time the channel moves into position, and includes the following steps:
[0050] S1. determining a first positional relationship between the camera and one end of the implant according to positions of the implant and the camera in a tracking system coordinate system;
[0051] In the tracking system coordinate system, the position of the camera is set as the origin of the tracking system coordinate system, and its vector is (0,0,0). The coordinate vector of one end of the implant relative to the camera is (X s ,Y s ,Z s ), then the first position relationship is vector a,
[0052] That is, a=(-X s ,-Ys ,-Z s );
[0053] Specifically, the implant includes a first target and a second target located at two ends respectively, and the first target and the second target are both located in the lesion. For example, the line between the first target and the second target is the position where the screw is to be inserted; the positions of the first target and the second target in the image coordinate system of the scanned image can be selected by the doctor, or obtained by planning by the software running in the host computer.
[0054] A patient equipped with a patient tracer may be scanned in advance to obtain a scanned image, wherein the scanned image may be a CT image or an X-ray image; then the coordinates of the patient tracer in the image coordinate system of the scanned image are determined, and combined with the coordinates of the patient tracer in the patient tracer coordinate system, a coordinate conversion relationship between the image coordinate system and the patient tracer coordinate system is obtained.
[0055] Moreover, the patient tracer can be positioned through the three-dimensional navigation tracking system to obtain the coordinate conversion relationship between the patient tracer coordinate system and the tracking system coordinate system; wherein, the coordinates of the patient tracer in the tracking system coordinate system can be determined by scanning or photographing the patient tracer by the tracking system, and the coordinate conversion relationship between the patient tracer coordinate system and the tracking system coordinate system can be obtained by combining the coordinates of the patient tracer in the patient tracer coordinate system, and then the coordinate conversion relationship between the image coordinate system and the tracking system coordinate system can be obtained.
[0056] Among them, according to the positions of the first target and the second target in the image coordinate system of the scanned image, combined with the coordinate conversion relationship between the image coordinate system and the tracking system coordinate system, the positions of the first target and the second target in the tracking system coordinate system can be obtained, and then the coordinate vector of the first target or the second target relative to the camera is determined.
[0057] The above method and principle for determining the end coordinate vector of the implant can refer to the contents disclosed in Chinese invention patent CN116473677A, a surgical navigation positioning method, device, electronic device and medium. The solution of this embodiment is a reference to its related technology and will not be elaborated here.
[0058] S2. Determine the optimal orientation of the double-sided tracer in the tracking system coordinate system according to the direction of the implant axis and in combination with the first positional relationship;
[0059] S2.1. Obtain a unit vector c according to the direction of the implant, where the direction of the implant is the direction of a line connecting the first target point and the second target point;
[0060] S2.2. According to the vector relationship between the unit vector c and the first position relationship, solve the projection relationship of the vector a in the direction of the unit vector c to obtain the vector c'.
[0061] c′=c·(a·c);
[0062] S2.3. According to the vector relationship between the first position relationship and the projection relationship, vector a and vector c' are connected to form a vector triangle abc', where vector b is the third vector in the vector triangle abc', i.e., the optimal orientation of the tracer, and the solution is:
[0063] b = ac'
[0064] Through the above method, this embodiment can determine the optimal orientation of any side of the double-sided tracer on the channel, so that the locator can be directly moved to the optimal visible position by the robotic arm during surgery, so that the tracer can be in the best visible state of the camera.
[0065] The optimal orientation refers to the direction in which the angle formed by the normal of the tracer plane relative to the vector of the first position relationship is the smallest when the axis of the locator channel coincides with the axis of the implant when the current implant position is determined.
[0066] As for the positional relationship between the channel and the double-sided tracer, as the most preferred, refer to Figure 4 As shown in the figure, the axis of the channel is set to be parallel to any tracing plane of the double-sided tracer, where S is the axis of the implant, the elliptical surface is the vertical plane of one end of the implant, and can also be the trajectory surface of the tracer rotating along the axis of the implant for a full circle, a is the vector of the first position relationship, that is, the vector between the camera and the tracing plane, c is the unit vector, c' is the projection of a in the direction of c, and b is the optimal orientation vector. Under the above settings, when the normal direction of any tracing plane coincides with the optimal orientation vector b, it is the optimal orientation of the double-sided tracer.
[0067] When the channel and the double-sided tracer have a certain design angle with each other due to various reasons, refer to Figure 5 As shown, the axis of the channel cannot be parallel to any tracing plane of the double-sided tracer. At this time, after the axis of the channel coincides with the axis of the implant, it is only necessary to coincide the normal of any tracing plane with the plane formed by the vector of the first position relationship and the implant axis or the vector of the first position relationship and the optimal orientation vector. In this state, it can also be the optimal orientation of the current double-sided tracer, forming the optimal visible position of the current locator. Figure 6 In this case, the normal to the tracer plane lies in the plane formed by vectors a and S.
[0068] Based on the same inventive concept, corresponding to the tracer orientation positioning method in the above-mentioned embodiment, the present application also provides a surgical navigation positioning device, including: a determination module;
[0069] The determination module,
[0070] for determining a first positional relationship between the camera 104 and one end of the implant according to positions of the implant and the camera 104 in a tracking system coordinate system;
[0071] It is also used to determine the optimal orientation of the double-sided tracer in the tracking system coordinate system based on the orientation of the implant in combination with the first positional relationship.
[0072] Optionally, the determining module is specifically used to:
[0073] According to the coordinates of the patient tracer in the image coordinate system of the scanned image, combined with the coordinates of the patient tracer in the patient tracer coordinate system, a coordinate conversion relationship between the image coordinate system and the patient tracer coordinate system is obtained;
[0074] Positioning the patient tracer through the three-dimensional navigation and tracking system, and obtaining the coordinate transformation relationship between the patient tracer coordinate system and the tracking system coordinate system;
[0075] The coordinate transformation relationship between the patient tracer coordinate system and the tracking system coordinate system is obtained by combining the coordinates of the patient tracer in the patient tracer coordinate system with the coordinate transformation relationship between the patient tracer coordinate system and the tracking system coordinate system;
[0076] The coordinate transformation relationship between the patient tracer coordinate system and the tracking system coordinate system is combined with the coordinate transformation relationship between the patient tracer coordinate system and the tracking system coordinate system to obtain the coordinate transformation relationship between the image coordinate system and the tracking system coordinate system;
[0077] The position of the implant in the tracking system coordinate system is obtained by combining the position of the implant in the image coordinate system with the coordinate transformation relationship between the image coordinate system and the tracking system coordinate system;
[0078] Optionally, the two ends of the implant are respectively the first target point and the second target point, and the determination module is used to determine the positions of the first target point and the second target point in the tracking system coordinate system, as well as the vector from the origin of the tracking system to the first target point or the second target point according to the position of the implant in the tracking system coordinate system.
[0079] Optionally, the determining module is specifically used to:
[0080] Obtain a unit vector based on the orientation of the implant;
[0081] According to the vector relationship between the unit vector and the first position relationship, solving the projection relationship of the vector of the first position relationship in the direction of the unit vector;
[0082] According to the vector relationship between the first position relationship and the projection relationship, an optimal orientation vector of the tracer is obtained.
[0083] The present application also provides an electronic device, including a processor and a memory, wherein the memory stores a computer program, and the processor runs the computer program to enable the electronic device to execute the functions of each module in the above-mentioned tracer orientation positioning method or the above-mentioned surgical navigation positioning device.
[0084] The present application also provides a readable storage medium for storing the computer program used in the above electronic device.
[0085] In several embodiments provided in the present application, it should be understood that the disclosed devices and methods can also be implemented in other ways. The device embodiments described above are merely schematic. For example, the flowcharts and structure diagrams in the accompanying drawings show the possible architecture, functions and operations of the devices, methods and computer program products according to multiple embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of a code, and the module, a program segment or a part of a code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in an alternative implementation, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the structure diagram and / or the flow diagram, and the combination of boxes in the structure diagram and / or the flow diagram, can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.
[0086] In addition, the functional modules or units in the various embodiments of the present application may be integrated together to form an independent part, or each module may exist separately, or two or more modules may be integrated to form an independent part.
[0087] If the function is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art, and the computer software product is stored in a storage medium, including several instructions for a computer device (which can be a smart phone, a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk.
[0088] Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.
Claims
1. A tracer orientation positioning method, characterized in that: The following steps are involved: S1. Determine a first positional relationship between the camera and one end of the implant according to the positions of the implant and the camera in the tracking system coordinate system; set the position of the camera as the origin of the tracking system coordinate system to obtain a vector of one end of the implant relative to the camera as the first positional relationship; S2, determining the optimal orientation of the tracer in the tracking system coordinate system according to the direction of the line connecting the first target point and the second target point in the implant in combination with the first positional relationship; The optimal orientation is the direction in which the angle formed by the normal of the tracer plane relative to the vector of the first positional relationship is the smallest when the axis of the locator channel coincides with the axis of the implant; The specific steps to determine the optimal orientation of the tracer in the tracking system coordinate system include: S2.1, obtaining a unit vector according to the direction of a line connecting a first target point and a second target point in the implant; S2.
2. according to the vector relationship between the unit vector and the first position relationship, solving the projection relationship vector of the vector of the first position relationship in the direction of the unit vector; S2.
3. Obtain an optimal orientation vector of the tracer according to the vector relationship between the first position relationship and the projection relationship.
2. A tracer orientation positioning method according to claim 1, characterized in that: In step S2, the tracer is in an optimal orientation in the tracking system coordinate system, and the normal of the tracer plane is located in a plane formed by the vector of the first positional relationship and the axis of the implant.
3. A tracer orientation positioning method according to claim 1, characterized in that: In step S2, the tracer is in an optimal orientation in the tracking system coordinate system, and the normal of the tracer plane coincides with the optimal orientation vector.
4. A tracer orientation positioning method according to any one of claims 1 to 3, characterized in that: The tracer is a double-sided tracer including two tracer planes. In step S2, the optimal orientation is the direction in which the angle formed by the normal on any of the tracer planes relative to the vector of the first position relationship is the smallest.
5. A surgical navigation positioning device, used to perform the tracer orientation positioning method according to any one of claims 1 to 4, characterized in that: A determination module is included, wherein the determination module is used to: Determining a first positional relationship between the camera and one end of the implant based on positions of the implant and the camera in a tracking system coordinate system; The optimal orientation of the double-sided tracer in the tracking system coordinate system is determined according to the direction of the line between the first target point and the second target point in the implant in combination with the first positional relationship.
6. A surgical navigation positioning device according to claim 5, characterized in that: The determining module is also used for: Obtaining a unit vector according to the direction of a line connecting a first target point and a second target point in the implant; solving a projection relationship of the first position relationship vector in the direction of the unit vector according to a vector relationship between the unit vector and the first position relationship; According to the vector relationship between the first position relationship and the projection relationship, an optimal orientation vector of the tracer is obtained.
7. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores computer executable instructions, and when the instructions are executed by the processor, they are used to implement the tracer orientation positioning method according to any one of claims 1 to 4.
8. A readable storage medium, characterized in that: The device stores a computer program, which, when executed on a processor, implements the tracer orientation positioning method according to any one of claims 1 to 4.
Citation Information
Patent Citations
Surgical navigation positioning method and device, electronic equipment and medium
CN116473677A
Calibration method for end tracer of surgical navigation robot
CN113040910A
Robot tail end operating system and method thereof
CN113456239A
Surgical instrument calibration and visual tracking method for optical navigation surgery
CN115429429A
Method, system and device for determining positioning tracer mounting groove and electronic equipment
CN115533863A
