Calibration device, system, method and storage medium
Through calibration devices and methods, the sensor module and calculation module sensing posture data, combined with pressure module and adjustment element fixing tool, the problem of tool calibration error in surgical navigation system is solved, and navigation accuracy and convenience of use are improved.
Patent Information
- Application Number
- CN202010760912.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-07-31
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2040-07-31
AI Technical Summary
The existing surgical navigation system has tool processing errors and deformation errors when calibrating surgical tools, resulting in navigation errors and making it difficult to accurately locate the characteristic points and postures of surgical tools.
Provide a calibration device and method, including a base, a calibration structure, a sensor module and a calculation module, and uses multiple sets of rotations by induced posture data on the identification device and the characteristic points on the tool, combining the pressure module and the adjustment element fixing tool. Position data fits the pose data of the tool to verify the groove calibration calibration accuracy.
It effectively avoids the influence of tool processing errors and deformation errors, improves the navigation accuracy of the surgical navigation system, is convenient for handheld use, and is suitable for calibration of a variety of customized surgical tools.
Smart Images

Figure CN111759462B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present application relate to the field of surgical navigation, and in particular, to a calibration device, system, method and storage medium. Background Art
[0002] In recent years, with the development of research fields such as medical imaging technology and image processing technology, surgical navigation systems have played an increasingly important role in the field of minimally invasive surgery. The surgical navigation system can effectively guide surgical instruments by visualizing local anatomical structures and locating the location of the lesion with high precision, thus expanding the doctor's limited visual range and making surgical operations more precise and safe. When doctors use surgical navigation systems to perform surgery, they need to observe and operate surgical instruments through a computer screen. Therefore, real-time tracking of surgical instruments is one of the key technologies for surgical navigation. There are currently a variety of surgical instrument tracking methods, such as mechanical tracking, ultrasonic tracking, optical tracking (OPT), and electromagnetic tracking (EMT). Regardless of the type of tracking method, it is necessary to identify the feature points at the fixed position of the instrument, and then use the known tool parameters to convert them into the position and posture of the instrument for display. However, we cannot obtain the theoretical parameters of most instruments used in surgery, and in actual applications, the dimensional errors caused by the tool processing process, the deformation errors caused by the tool itself being affected by the environment, etc., all of these errors will be introduced into the navigation error. Therefore, before putting the surgical tools into use, they need to be calibrated to determine the relative position and posture relationship between the feature points at fixed positions on the surgical tools and the surgical tools, so that when using the surgical navigation system, the position and posture data of the surgical tools can be obtained based on the position and posture data of the feature points at fixed positions on the surgical tools. Summary of the invention
[0003] In view of this, embodiments of the present application provide a calibration device, method and storage medium for calibrating a tool.
[0004] In the first aspect, an embodiment of the present application provides a calibration device, comprising: a base and a calibration structure; the calibration structure is arranged on the base, and the calibration structure is used to accommodate a tool to be calibrated so as to calibrate the tool to be calibrated; a first marker is also arranged on the base, and the first marker is used to be sensed by a sensor module to obtain posture data indicating the posture of the calibration device, so as to cooperate with the calibration structure to calibrate the tool to be calibrated, and the posture data includes position data of the calibration device and posture data of the calibration device.
[0005] Optionally, in a specific implementation, the calibration structure includes a calibration groove, the calibration groove is arranged on the top of the base, and the position data of the calibration groove relative to the first marker is known data.
[0006] Optionally, in a specific embodiment, the calibration device further includes a pressure module, and the pressure module is used to apply pressure to the tool to be calibrated to fix the tool to be calibrated in the calibration structure.
[0007] Optionally, in a specific embodiment, the calibration device further includes a pressure cover, which is arranged on the top of the base and is used to install the pressure module.
[0008] Optionally, in a specific embodiment, the pressure module includes an adjusting element, a connecting element and a pressure applying element;
[0009] The connecting element passes through the gland, with the upper end extending out of the top of the gland and the lower end being located in the calibration structure;
[0010] The pressure-applying element is connected to the lower end of the connecting element, and the pressure-applying element is used to apply pressure to the tool to be calibrated to fix the tool to be calibrated;
[0011] The adjusting element is connected to the upper end of the connecting element, and is used to adjust the pressure applied by the pressure-applying element to the tool to be calibrated.
[0012] Optionally, in a specific implementation, the calibration structure further includes at least one calibration hole, the calibration hole is disposed on the base, and the position data of the calibration hole relative to the first marker is known data.
[0013] Optionally, in a specific embodiment, the base is provided with a groove, dividing the base into a calibration plate and a base body; the calibration hole is located on the calibration plate and passes through the calibration plate, so that the tool to be calibrated passes through the calibration hole and the groove and rests on the base body.
[0014] Optionally, in a specific implementation, the diameter data of each calibration hole is different, and a number indicating the diameter data of the calibration hole is provided next to the calibration hole.
[0015] Optionally, in a specific embodiment, the calibration device includes at least three first marks, and the first marks are arranged on the top of the base, are circular, and the inside of the circle is filled with black and white colors at intervals.
[0016] Optionally, in a specific embodiment, at least one verification groove is further provided on the base, and the verification groove is used to verify the calibration accuracy of the calibration device, and the posture data of the verification groove relative to the first marker is known data.
[0017] Optionally, in a specific embodiment, a hand-held portion is further provided at the bottom of the base for fixing the calibration device by holding.
[0018] In a second aspect, an embodiment of the present application provides a calibration system, comprising: a calibration device as described in any one of the first aspects, a sensor module, a tool to be calibrated, and a computing module; the tool to be calibrated is fixed in a calibration structure of the calibration device; the sensor module is communicatively connected with the computing module;
[0019] The sensor module is used to generate first position data of the first marker relative to the sensor module according to the sensed first marker on the calibration device, wherein the first position data includes position data of the first marker relative to the sensor module and posture data of the first marker relative to the sensor module;
[0020] The sensor module is also used to generate second position data of the second marker relative to the sensor module according to the second marker sensed on the tool to be calibrated, the second position data including position data of the second marker relative to the sensor module and posture data of the second marker relative to the sensor module;
[0021] The calculation module is used to calibrate the tool to be calibrated according to the first posture data and the second posture data.
[0022] In a third aspect, an embodiment of the present application provides a calibration method, including:
[0023] Generate first position data of the first marker relative to the sensor module according to the first marker on the calibration device sensed by the sensor module, the first position data including position data of the first marker relative to the sensor module and posture data of the first marker relative to the sensor module;
[0024] Generate second position data of the second marker relative to the sensor module according to the second marker on the tool to be calibrated sensed by the sensor module, the second position data including position data of the second marker relative to the sensor module and posture data of the second marker relative to the sensor module;
[0025] The tool to be calibrated is calibrated according to the first pose data and the second pose data.
[0026] Optionally, in a specific implementation, calibrating the tool to be calibrated according to the first pose data and the second pose data includes:
[0027] Obtain third posture data of the first marker relative to the second marker according to the first posture data and the second posture data, wherein the third posture data includes position data of the first marker relative to the second marker and posture data of the first marker relative to the second marker;
[0028] Reading the position data of the calibration hole matched with the end diameter of the tool to be calibrated relative to the first mark;
[0029] The calibration pose data of the end of the tool to be calibrated relative to the second marker is obtained according to the third pose data and the pose data of the calibration hole matched with the end diameter of the tool to be calibrated relative to the first marker.
[0030] Optionally, in a specific embodiment, the second posture data includes initial second posture data and multiple sets of rotated second posture data, the initial second posture data is used to indicate the posture data of the second identifier relative to the sensor module when the tool to be calibrated is in an initial position, and the multiple sets of rotated second posture data are used to indicate the posture data of the second identifier relative to the sensor module when the tool to be calibrated is rotated at different angles in the calibration slot.
[0031] Optionally, in a specific implementation, calibrating the tool to be calibrated according to the first pose data and the second pose data includes:
[0032] Obtain fourth posture data of the first marker relative to the second marker at the initial position according to the first posture data and the initial second posture data, the fourth posture data including position data of the first marker relative to the second marker at the initial position and posture data of the first marker relative to the second marker at the initial position;
[0033] Reading the position data of the calibration slot relative to the first marker;
[0034] Obtaining the posture data of the end of the tool to be calibrated relative to the first mark according to the multiple sets of rotational second posture data and the posture data of the calibration groove relative to the first mark;
[0035] The calibration posture data of the end of the tool to be calibrated relative to the second marker is obtained according to the posture data of the end of the tool to be calibrated relative to the first marker and the fourth posture data.
[0036] Optionally, in a specific implementation, obtaining the posture data of the end of the tool to be calibrated relative to the first mark according to the multiple sets of rotated second posture data and the posture data of the calibration groove relative to the first mark includes:
[0037] Fitting multiple sets of rotated second posture data by least square method to obtain posture data of the end of the tool to be calibrated relative to the sensor module;
[0038] The posture data of the end of the tool to be calibrated relative to the first marker is obtained according to the posture data of the end of the tool to be calibrated relative to the sensor module and the first posture data.
[0039] Optionally, in a specific embodiment, the method further comprises:
[0040] Reading and verifying the position data of the groove relative to the first mark;
[0041] Place the end of the tool to be calibrated against the verification groove, and obtain the position and posture data of the first marker relative to the sensor module and the position and posture data of the second marker relative to the sensor module through the sensor module;
[0042] Obtaining the position and posture data of the verification groove relative to the sensor module according to the position and posture data of the verification groove relative to the first mark and the position and posture data of the first mark relative to the sensor module;
[0043] Obtaining the position and posture data of the verification groove relative to the second identifier according to the position and posture data of the verification groove relative to the sensor module and the position and posture data of the second identifier relative to the sensor module;
[0044] The error of the calibration pose data is determined based on the pose data of the verification groove relative to the second marker.
[0045] In a fourth aspect, an embodiment of the present application provides a storage medium having a computer program stored thereon, and when a processor executes the computer program, a method as described in any one of the third aspects is implemented.
[0046] The calibration device provided in the embodiment of the present application is small in size, can be handheld and fixed, is easy to use, and can calibrate the relative posture relationship between feature points at fixed positions on a variety of custom surgical tools and the surgical tools, effectively avoiding the introduction of tool processing errors, deformation errors, etc. into the surgical navigation system, thereby improving the accuracy of navigation. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] Hereinafter, some specific embodiments of the present application will be described in detail in an exemplary and non-limiting manner with reference to the accompanying drawings. The same reference numerals in the accompanying drawings indicate the same or identical components or parts. It should be understood by those skilled in the art that these drawings are not necessarily drawn to scale. In the accompanying drawings:
[0048] Figure 1 A schematic diagram of a calibration device provided in an embodiment of the present application;
[0049] Figure 2 A schematic diagram of a first identification provided in an embodiment of the present application;
[0050] Figure 3 A schematic diagram of a calibration hole and a verification hole in a calibration device provided in an embodiment of the present application;
[0051] Figure 4 A schematic diagram of a handheld portion of a calibration device provided in an embodiment of the present application;
[0052] Figure 5 A flow chart of a calibration method provided in an embodiment of the present application;
[0053] Figure 6A flowchart of a method for verifying calibration accuracy provided in an embodiment of the present application;
[0054] Figure 7 A flowchart of another calibration method provided in an embodiment of the present application;
[0055] Figure 8 A flowchart of a method for verifying calibration error provided in an embodiment of the present application.
[0056] Explanation of the reference numerals: base 10, first mark 101, groove 102, calibration plate 103, base body 104, verification groove 105, hand-held part 106, calibration structure 20, calibration groove 201, calibration hole 202, pressure module 30, adjustment element 301, connecting element 302, pressure element 303, pressure cover 40. DETAILED DESCRIPTION
[0057] The specific implementation of the embodiment of the present invention is further described below in conjunction with the accompanying drawings of the embodiment of the present invention.
[0058] Embodiment 1
[0059] See also Figure 1 The embodiment of the present application provides a calibration device, including: a base 10 and a calibration structure 20; the calibration structure 20 is arranged on the base 10, and the calibration structure 20 is used to accommodate the tool to be calibrated so as to calibrate the tool to be calibrated; a first mark 101 is also arranged on the base 10, and the first mark 101 is used to be sensed by the sensor module to obtain posture data indicating the posture of the calibration device, so as to cooperate with the calibration structure 20 to calibrate the tool to be calibrated, and the posture data includes position data of the calibration device and posture data of the calibration device.
[0060] Specifically, the size of the base 10 can be 95mm*70mm*48mm, which is convenient to hold by hand, making the calibration process of the calibration tool using the calibration device more convenient and quick. The first mark 101 can be an image that can be recognized by a sensor module such as a camera, etc. Preferably, there can be at least 3 first marks 101, see Figure 2 , Figure 2 Four first marks 101 are arranged on the top of the base 10 of the calibration device. The first marks 101 are circular, and the circle is equally divided into four quarters of a circle, which are filled with black and white colors at intervals. This makes it easy for the sensor module to identify it. Of course, this is just an example. The first mark 101 can also be other shapes and colors, as long as it can be recognized by the sensor module. This application does not impose any restrictions on this.
[0061] The tool to be calibrated is generally in the shape of a needle, and a feature point is set at a fixed position of the tool to be calibrated. The sensor module can sense the position data and posture data of the feature point. The calibration of the tool to be calibrated is to determine the position data and posture data of the end of the tool to be calibrated relative to the feature point, that is, to determine the position data and posture data of the needle tip of the tool to be calibrated relative to the feature point. Therefore, in the actual surgical process, after the position data and posture data of the feature point are obtained through the sensor module, the position data and posture data of the needle tip of the tool to be calibrated can be obtained by calculation, which is convenient for navigating the tool to be calibrated.
[0062] The sensor module may be a camera, a video camera, an image recording device, a position sensor, a posture sensor, or other device capable of sensing the position and posture of the first marker 101 .
[0063] See also Figure 3 Optionally, in a specific implementation, the calibration structure 20 includes a calibration groove 201, and the calibration groove 201 is arranged on the top of the base 10, and the position data of the calibration groove 201 relative to the first marker 101 is known data.
[0064] In detail, when calibrating the tool to be calibrated through the calibration groove 201, the needle-shaped tool to be calibrated can be placed in the calibration groove 201 first, and the end of the tool to be calibrated can be against the groove wall of the calibration groove 201. The position data of the calibration groove 201 relative to the first identifier 101 can be the position data and posture data of the groove wall relative to the first identifier 101. After the position data of the first identifier 101 is obtained through the sensor module, the position data and posture data of the groove wall can be obtained by calculation.
[0065] Optionally, in a specific implementation, the calibration device further includes a pressure module 30 , and the pressure module 30 is used to apply pressure to the tool to be calibrated to fix the tool to be calibrated in the calibration structure 20 .
[0066] Specifically, the pressure module 30 can be used to apply pressure to the tool to be calibrated to fix the tool to be calibrated in the calibration groove 201, so that the tool to be calibrated and the calibration device are relatively fixed during the calibration process, thereby improving the calibration accuracy.
[0067] Optionally, in a specific implementation, the calibration device further includes a pressure cover 40 , which is disposed on the top of the base 10 and is used to install the pressure module 30 .
[0068] Optionally, in a specific embodiment, the pressure module 30 includes an adjusting element 301, a connecting element 302 and a pressure applying element 303;
[0069] The connecting element 302 passes through the gland 40, with the upper end extending out of the top of the gland 40 and the lower end located in the calibration structure 20;
[0070] The pressure-applying element 303 is connected to the lower end of the connecting element 302, and the pressure-applying element 303 is used to apply pressure to the tool to be calibrated to fix the tool to be calibrated;
[0071] The adjusting element 301 is connected to the upper end of the connecting element 302 , and the adjusting element 301 is used to adjust the pressure applied by the pressure applying element 303 to the tool to be calibrated.
[0072] Preferably, the adjusting element 301 may be a handle, the connecting element 302 may be a connecting rod, and the pressure element 303 may be a pressing block; wherein: the connecting rod passes through the pressure cover 40, the upper end of the connecting rod extends out of the top of the pressure cover 40, and the lower end of the connecting rod is located in the calibration groove 201; the handle is connected to the upper end of the connecting rod, and is used to control the raising or lowering of the pressing block; the pressing block is connected to the lower end of the connecting rod, and is used to apply pressure to the tool to be calibrated when lowering to fix the tool to be calibrated in the calibration groove 201. In a specific embodiment, the pressing block can be raised or lowered by rotating the handle so as to press the tool to be calibrated in the calibration groove 201. For example, the handle can be fixedly connected to the connecting rod, the pressing block can be fixedly connected to the connecting rod, and the connecting rod can be threadedly connected to the pressure cover 40, so that the pressing block can be raised or lowered accordingly when the handle is rotated. Of course, this is only an exemplary description, and does not mean that the present application is limited to this.
[0073] Optionally, in a specific implementation, the calibration structure 20 further includes at least one calibration hole 202 , and the calibration hole 202 is disposed on the base 10 , and the position data of the calibration hole 202 relative to the first marker 101 is known data.
[0074] See also Figure 4 Optionally, in a specific embodiment, the base 10 is provided with a groove 102, dividing the base 10 into a calibration plate 103 and a base body 104; the calibration hole 202 is located on the calibration plate 103 and passes through the calibration plate 103, so that the tool to be calibrated passes through the calibration hole 202 and the groove 102, and rests on the base body 104.
[0075] In detail, when calibrating the tool to be calibrated through the calibration hole 202, the needle-shaped tool to be calibrated can be first passed through the calibration hole 202 and the groove 102, and abutted against the base body 104. The position and posture data of the calibration hole 202 relative to the first mark 101 can be the position data and posture data of the projection of the center of the calibration hole 202 on the base body 104 relative to the first mark 101. After the position and posture data of the first mark 101 and the position and posture data of the feature points on the tool to be calibrated are obtained through the sensor module, the position data and posture data of the feature points on the tool to be calibrated relative to the projection of the center of the calibration hole 202 on the base body 104 can be obtained by calculation, that is, the position data and posture data of the feature points on the tool to be calibrated relative to the end of the tool to be calibrated. The groove 102 that divides the base 10 into the calibration plate 103 and the base body 104 can be used to confirm whether the end of the tool to be calibrated is against the base body 104, which is conducive to improving the accuracy of calibration.
[0076] Optionally, in a specific implementation, the diameter data of each calibration hole 202 is different, and a number for indicating the diameter data of the calibration hole 202 is set next to the calibration hole 202 .
[0077] Specifically, the number and diameter of the calibration holes 202 can be set according to actual needs. In a specific implementation, the number of calibration holes can be set to 14, and the diameter parameters are:
[0078] 1.0mm, 2.0mm, 2.5mm, 2.7mm, 3.0mm, 3.2mm, 3.5mm, 4.0mm, 4.5mm, 5.0mm, 6.0mm, 6.5mm, 7.5mm, 10mm, these diameter parameters are some common diameter parameters of the tools to be calibrated, which are only illustrative and do not mean that the present application is limited thereto. In this way, the calibration process can be made faster and more accurate.
[0079] Optionally, in a specific embodiment, at least one verification groove 105 is further provided on the base 10, and the verification groove 105 is used to verify the calibration accuracy of the calibration device, and the posture data of the verification groove 105 relative to the first identifier 101 is known data.
[0080] In detail, the verification groove 105 can be hemispherical or conical, and is used to calculate the calibration accuracy after calibrating the position data and posture data of the feature points on the tool to be calibrated relative to the end of the tool to be calibrated. Specifically, the end of the tool to be calibrated can be placed against the bottom of the verification groove 105, and the posture data of the first identifier 101 and the posture data of the second identifier can be obtained through the sensor module. The posture data of the verification groove 105 relative to the first identifier 101 can be the posture data of the bottom of the verification groove 105 relative to the first identifier 101. In this way, the posture data of the bottom of the verification groove 105, that is, the posture data of the end of the tool to be calibrated, can be obtained by calculation. At the same time, the posture data of the end of the tool to be calibrated can also be calculated through the posture data of the second identifier. The posture data of the end of the tool to be calibrated calculated by the second identifier is compared with the posture data of the end of the tool to be calibrated calculated by the bottom of the verification groove 105, so as to obtain the calibration accuracy. Preferably, the comparison results may be divided into a plurality of levels, and different levels correspond to different calibration accuracies, which is conducive to more clearly indicating the calibration accuracy.
[0081] Optionally, in one embodiment of the present application, a handheld portion 106 is further provided at the bottom of the base 10 .
[0082] In this way, it is convenient for users to hold the device, which is beneficial to improving the user experience.
[0083] In addition, it should be specially explained that in the present application, the expression "pose data of A relative to B" can have the following meaning: pose data of A in the coordinate system established with B as the reference. The rules of the first identification 101 coordinate system established with B as the reference are known, that is, the pose data of the coordinate system established with B as the reference in the C coordinate system can be obtained through the pose data of B in the C coordinate system, and the pose data of B in the C coordinate system can also be obtained through the pose data of the coordinate system established with B as the reference in the C coordinate system. The present application does not limit the specific rules for establishing the coordinate system.
[0084] There are three coordinate systems in the calibration process, namely: the coordinate system {C} established with the sensor module as the reference, the coordinate system {M1} established with the first mark 101 as the reference, and the coordinate system {M2} established with the feature point on the tool to be calibrated, that is, the second mark as the reference. The calibration process of the tool to be calibrated is the process of confirming the position and posture data of the end of the tool to be calibrated in the coordinate system {M2} established with the second mark as the reference.
[0085] Embodiment 2
[0086] The embodiment of the present application provides a calibration system, including: a calibration device, a sensor module, a tool to be calibrated and a calculation module; the tool to be calibrated is fixed in a calibration structure 20 of the calibration device; the sensor module is in communication connection with the calculation module;
[0087] The sensor module is used to generate first position data of the first identifier 101 relative to the sensor module according to the first identifier 101 sensed on the calibration device, wherein the first position data includes position data of the first identifier 101 relative to the sensor module and posture data of the first identifier 101 relative to the sensor module;
[0088] The sensor module is also used to generate second position data of the second marker relative to the sensor module according to the second marker sensed on the tool to be calibrated, the second position data including position data of the second marker relative to the sensor module and posture data of the second marker relative to the sensor module;
[0089] The calculation module is used to calibrate the tool to be calibrated according to the first posture data and the second posture data.
[0090] Specifically, the second mark is the feature point of the tool to be calibrated. The calculation module can be a computer, mobile phone or other computer equipment. The sensor module sends the sensed posture data of the first mark 101 and / or the posture data of the second mark to the calculation module so that the calculation module can calibrate the tool to be calibrated. For the specific calculation process, please refer to Example 3.
[0091] Embodiment 3
[0092] See also Figure 5 , the present application embodiment provides a calibration method, including:
[0093] S501: generating first position data of the first marker 101 relative to the sensor module according to the first marker 101 on the calibration device sensed by the sensor module, wherein the first position data includes position data of the first marker 101 relative to the sensor module and posture data of the first marker 101 relative to the sensor module;
[0094] Specifically, the first position data may be the position data of the first identifier 101 in {C}, and the first position data may be directly obtained through the sensor module.
[0095] S502: generating second position data of the second marker relative to the sensor module according to the second marker on the tool to be calibrated sensed by the sensor module, wherein the second position data includes position data of the second marker relative to the sensor module and posture data of the second marker relative to the sensor module;
[0096] Specifically, the second posture data may be the posture data of the second identifier in {C}, and the second posture data may be directly obtained through the sensor module.
[0097] S503: Calibrate the tool to be calibrated according to the first pose data and the second pose data.
[0098] For ease of description, the transformation relationship between different coordinate systems can be defined as follows: The transformation relationship from {M1} to {C} is expressed as The conversion relationship from {C} to {M1} is expressed as Here we explain the role of known coordinate system transformation relations: For example, if it is known that The posture data of the second marker in {M1} can be converted into the posture data of the second marker in {C}. Other conversion relationships are similar and will not be described here.
[0099] Given the conversion relationship from {M1} to {C} The conversion relationship from {C} to {M1} can be obtained by the following formula:
[0100]
[0101] in It refers to the conversion relationship from {C} to {M1}. is the rotation matrix from {M1} to {C}, C p M1o It refers to the translation matrix from {M1} to {C}. The symbols that appear in the following text have the same meaning and will not be repeated here.
[0102] Optionally, in a specific embodiment, the second posture data includes initial second posture data and multiple sets of rotated second posture data, the initial second posture data is used to indicate the posture data of the second identifier relative to the sensor module when the tool to be calibrated is in an initial position, and the multiple sets of rotated second posture data are used to indicate the posture data of the second identifier relative to the sensor module when the tool to be calibrated is rotated at different angles in the calibration slot 201.
[0103] Specifically, the pose data of the second mark relative to the sensor module when the tool to be calibrated is in the initial position can be defined as the initial second pose data, that is, the pose data of the second mark in {C} when the tool to be calibrated is in the initial position can be defined as the initial second pose data; during the calibration process, the tool to be calibrated will be rotated in the calibration slot 201 for many times so that the trajectory of the second mark forms a circle, the center of which falls on the straight line where the end of the tool to be calibrated is located, and the pose data of the end of the tool to be calibrated in {C} or {M1} can be obtained by calculating the pose data of the center of the circle in {C} or {M1}. Since the tool to be calibrated is rotated for many times during the calibration process, there will be multiple coordinate systems established with the second mark as the reference, and the coordinate system established with the second mark as the reference when the tool to be calibrated is in the initial position is defined as {M2}.
[0104] See also Figure 6 Optionally, in a specific implementation, calibrating the tool to be calibrated according to the first pose data and the second pose data includes:
[0105] S601: Obtain fourth posture data of the first marker 101 relative to the second marker at the initial position according to the first posture data and the initial second posture data, the fourth posture data including position data of the first marker 101 relative to the second marker at the initial position and posture data of the first marker 101 relative to the second marker at the initial position;
[0106] That is, the posture data of the first marker 101 in {M2} is obtained according to the posture data of the first marker 101 in {C} and the posture data of the second marker in {C}, including:
[0107] a. Convert the pose data of the first marker 101 in {C} into the pose data of the sensor module in {M1}:
[0108]
[0109] b. Obtain the pose data of the second marker in {M1} according to the pose data of the sensor module in {M1} and the pose data of the second marker in {C}:
[0110]
[0111] c: Obtain the pose data of the first marker 101 in {M2} according to the pose data of the second marker in {M1}:
[0112]
[0113] S602: Reading the position data of the calibration groove 201 relative to the first mark 101;
[0114] S603: Obtaining the posture data of the end of the tool to be calibrated relative to the first mark 101 according to the multiple sets of rotational second posture data and the posture data of the calibration groove 201 relative to the first mark 101;
[0115] Optionally, in a specific implementation, obtaining the posture data of the end of the tool to be calibrated relative to the first mark 101 according to the multiple sets of rotated second posture data and the posture data of the calibration groove 201 relative to the first mark 101 includes:
[0116] Fitting multiple sets of rotated second posture data by least square method to obtain posture data of the end of the tool to be calibrated relative to the sensor module;
[0117] Specifically, during the calibration process, the tool to be calibrated will be rotated in the calibration groove 201 for multiple times so that the trajectory of the second mark forms a circle, the center of the circle falls on the straight line where the end of the tool to be calibrated is located, and the plane where the circle is located is perpendicular to the upper end surface of the base 10, and the equation of the circle can be fitted in a two-dimensional plane.
[0118] Ignore the change of the position coordinate of the second mark in {C} in the direction perpendicular to the plane where the circle is located, and assume that multiple sets of position data are (x1, y1), (x2, y2), ..., (x n ,y n ), where n is a positive integer.
[0119] The general equation of a circle is x 2 +y 2 +ax+by+c=0, the coordinates of the center of the circle are Among them, a, b, and c are unknown parameters. The equation of the circle where the position data is located is fitted by the least squares method. The error equation can be expressed as:
[0120]
[0121] make Right now
[0122]
[0123]
[0124]
[0125] set up
[0126] Then we can get:
[0127]
[0128] The solution is:
[0129]
[0130] Substituting multiple sets of rotated second pose data, the coordinates of the center of the circle in two directions in {C} can be calculated.
[0131] The center of the circle is mapped to the wall of the calibration groove 201 against which the end of the tool to be calibrated is pressed to obtain the coordinates of the last direction. In this way, the coordinate data obtained is the position data of the needle tip of the tool to be calibrated in the camera coordinate system. Specifically, the position data of the wall of the calibration groove 201 against which the end of the tool to be calibrated is pressed in {M1} and The position data of the groove wall of the calibration groove 201 against which the end of the tool to be calibrated is resting in {C} are obtained, and then the center of the circle formed by the rotation of the second marker is mapped to the groove wall of the calibration groove 201 against which the end of the tool to be calibrated is resting to obtain the coordinates in the last direction, that is, the position data of the end of the tool to be calibrated in {C} are obtained, that is, the position data of the end of the tool to be calibrated relative to the sensor module.
[0132] The posture data of the end of the tool to be calibrated relative to the first marker 101 is obtained according to the posture data of the end of the tool to be calibrated relative to the sensor module and the first posture data.
[0133] That is, the pose data of the end of the tool to be calibrated in {M1} is obtained according to the pose data of the end of the calibration tool in {C} and the pose data of the first mark 101 in {C}. The specific calculation method is the same as the calculation method of obtaining the pose data of the first mark 101 in {M2} according to the pose data of the first mark 101 in {C} and the pose data of the second mark in {C}, and will not be repeated here.
[0134] It should be noted that: it is also possible to convert multiple sets of rotated second posture data into multiple sets of posture data of the second mark in {M1}, and then combine the posture data of the groove wall of the calibration groove 201 in {M1} against which the end of the tool to be calibrated is against to calculate the coordinates of the last direction of the end of the tool to be calibrated.
[0135] S604: Obtain calibration pose data of the end of the tool to be calibrated relative to the second marker according to the pose data of the end of the tool to be calibrated relative to the first marker 101 and the fourth pose data.
[0136] The specific calculation method is the same as the calculation method for obtaining the posture data of the second marker in {M1} based on the posture data of the sensor module in {M1} and the posture data of the second marker in {C}, and will not be repeated here.
[0137] See also Figure 7Optionally, in a specific implementation, calibrating the tool to be calibrated according to the first pose data and the second pose data includes:
[0138] S701: Obtain third posture data of the first marker 101 relative to the second marker according to the first posture data and the second posture data, wherein the third posture data includes position data of the first marker 101 relative to the second marker and posture data of the first marker 101 relative to the second marker;
[0139] That is, the posture data of the first marker 101 in {M2} is obtained according to the posture data of the first marker 101 in {C} and the posture data of the second marker in {C}.
[0140] S702: Reading the position data of the calibration hole 202 that matches the end diameter of the tool to be calibrated relative to the first mark 101;
[0141] Specifically, the pose data of the calibration hole 202 adapted to the end diameter of the tool to be calibrated relative to the first identifier 101 can be the position data and posture data of the projection of the center of the calibration hole 202 on the base body 104 relative to the first identifier 101, that is, the pose data of the projection of the center of the calibration hole 202 on the base body 104 in {M1}, that is, the pose data of the end of the tool to be calibrated in {M1}.
[0142] S703: Obtain calibration pose data of the end of the tool to be calibrated relative to the second marker according to the third pose data and the pose data of the calibration hole 202 matched with the end diameter of the tool to be calibrated relative to the first marker 101 .
[0143] That is, the posture data of the end of the tool to be calibrated in {M2} is obtained according to the posture data of the first marker 101 in {M2} and the posture data of the projection of the center of the calibration hole 202 on the base body 104 in {M1}. The specific calculation method is the same as the calculation method of obtaining the posture data of the second marker in {M1} according to the posture data of the sensor module in {M1} and the posture data of the second marker in {C}, and will not be repeated here.
[0144] See also Figure 8 Optionally, in a specific implementation, the method further comprises:
[0145] S801: Reading and verifying the position data of the groove 105 relative to the first mark 101;
[0146] Specifically, the posture data of the verification groove 105 relative to the first mark 101 may be the posture data of the groove bottom of the verification groove 105 relative to the first mark 101 , that is, the posture data of the groove bottom of the verification groove 105 in {M1}.
[0147] S802: placing the end of the tool to be calibrated against the verification groove 105, and obtaining the position and posture data of the first mark 101 relative to the sensor module and the position and posture data of the second mark relative to the sensor module through the sensor module;
[0148] That is, the position and posture data of the first marker 101 in {C} and the position and posture data of the second marker in {C} are obtained.
[0149] S803: Obtaining the position and posture data of the verification groove 105 relative to the sensor module according to the position and posture data of the verification groove 105 relative to the first mark 101 and the position and posture data of the first mark 101 relative to the sensor module;
[0150] That is, the posture data of the bottom of the verification groove 105 in {C} is obtained based on the posture data of the bottom of the verification groove 105 in {M1} and the posture data of the first identifier 101 in {C}. The specific calculation method is the same as the calculation method for obtaining the posture data of the second marker in {M1} based on the posture data of the sensor module in {M1} and the posture data of the second marker in {C}, and will not be repeated here.
[0151] S804: Obtaining the posture data of the verification groove 105 relative to the second identifier according to the posture data of the verification groove 105 relative to the sensor module and the posture data of the second identifier relative to the sensor module;
[0152] That is, the posture data of the bottom of the verification groove 105 in {M2} is obtained based on the posture data of the bottom of the verification groove 105 in {C} and the posture data of the second marker in {C}. The specific calculation method is the same as the calculation method for obtaining the posture data of the first marker 101 in {M2} based on the posture data of the first marker 101 in {C} and the posture data of the second marker in {C}, and will not be repeated here.
[0153] S805: Determine the error of the marking pose data according to the pose data of the verification groove 105 relative to the second marker.
[0154] Specifically, the posture data of the verification groove 105 relative to the second mark is the posture data of the verification groove 105 in {M2}, that is, the posture data of the end of the tool to be calibrated in {M2}. The difference between the posture data of the verification groove 105 relative to the second mark and the calibration posture data reflects the calibration accuracy. The larger the difference, the worse the calibration accuracy. The difference between the posture data of the verification groove 105 relative to the second mark and the calibration posture data can be quantified to grade the calibration accuracy, and it can also be visualized on a graphical interface to facilitate intuitive presentation of the calibration accuracy.
[0155] Embodiment 4
[0156] An embodiment of the present application provides a storage medium having a computer program stored thereon. When a processor executes the computer program, a method as described in any one of the third embodiments is implemented.
[0157] The storage medium of the embodiment of the present application exists in various forms, including but not limited to:
[0158] (1) Mobile communication devices: These devices are characterized by their mobile communication functions and their main purpose is to provide voice and data communications. These terminals include: smart phones (such as iPhone), multimedia phones, functional phones, and low-end phones.
[0159] (2) Ultra-mobile personal computer devices: These devices fall into the category of personal computers, have computing and processing capabilities, and generally also have mobile Internet access features. These terminals include: PDA, MID and UMPC devices, such as iPad.
[0160] (3) Portable entertainment devices: These devices can display and play multimedia content. They include audio and video players (such as iPods), handheld game consoles, e-books, smart toys, and portable car navigation devices.
[0161] (4) Other electronic devices with data interaction functions.
[0162] Thus far, specific embodiments of the subject matter have been described. Other embodiments are within the scope of the appended claims. In some cases, the actions recited in the claims may be performed in a different order and still achieve the desired results. Additionally, the processes depicted in the accompanying drawings do not necessarily require the specific order or sequential order shown to achieve the desired results. In some embodiments, multitasking and parallel processing may be advantageous.
[0163] In the 1990s, improvements to a technology could be clearly distinguished as hardware improvements (for example, improvements to the circuit structure of diodes, transistors, switches, etc.) or software improvements (improvements to the method flow). However, with the development of technology, many improvements to the method flow today can be regarded as direct improvements to the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that an improvement in a method flow cannot be implemented using a hardware entity module. For example, a programmable logic device (PLD) (such as a field programmable gate array (FPGA)) is such an integrated circuit whose logical function is determined by the user's programming of the device. Designers can "integrate" a digital system on a PLD by programming it themselves, without having to ask a chip manufacturer to design and produce a dedicated integrated circuit chip. Moreover, nowadays, instead of manually making integrated circuit chips, this kind of programming is mostly implemented by "logic compiler" software, which is the same as the software compiler used when developing and writing programs, and the original code before compilation must also be written in a specific programming language, which is called hardware description language (HDL). There is not only one HDL, but many kinds, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also know that it is only necessary to program the method flow slightly in the above-mentioned hardware description languages and program it into the integrated circuit, and then it is easy to obtain the hardware circuit that implements the logic method flow.
[0164] The controller can be implemented in any appropriate manner, for example, the controller can take the form of a microprocessor or processor and a computer-readable medium storing a computer-readable program code (such as software or firmware) that can be executed by the (micro)processor, a logic gate, a switch, an application-specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller. Examples of controllers include, but are not limited to, the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320. The memory controller can also be implemented as part of the control logic of the memory. Those skilled in the art also know that in addition to implementing the controller in a purely computer-readable program code manner, the controller can be implemented in the form of a logic gate, a switch, an application-specific integrated circuit, a programmable logic controller, and an embedded microcontroller by logically programming the method steps. Therefore, this controller can be considered as a hardware component, and the devices included therein for implementing various functions can also be regarded as structures within the hardware component. Or even, the devices for implementing various functions can be regarded as both software modules for implementing the method and structures within the hardware component.
[0165] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
[0166] For the convenience of description, the above device is described in various units according to their functions. Of course, when implementing the present application, the functions of each unit can be implemented in the same or multiple software and / or hardware.
[0167] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that include computer-usable program code.
[0168] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0169] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0170] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0171] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0172] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0173] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.
[0174] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.
[0175] The present application may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific transactions or implement specific abstract data types. The present application may also be practiced in distributed computing environments where transactions are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.
[0176] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0177] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims
1. A calibration method, characterized in that: include: Generate first pose data of the first marker relative to the sensor module according to the first marker on the calibration device sensed by the sensor module, wherein the first pose data includes position data of the first marker relative to the sensor module and pose data of the first marker relative to the sensor module; Generate second position data of the second marker relative to the sensor module according to the second marker on the tool to be calibrated sensed by the sensor module, wherein the second position data includes position data of the second marker relative to the sensor module and posture data of the second marker relative to the sensor module; Calibrating the tool to be calibrated according to the first posture data and the second posture data includes: Obtaining third posture data of the first marker relative to the second marker according to the first posture data and the second posture data, wherein the third posture data includes position data of the first marker relative to the second marker and posture data of the first marker relative to the second marker; Reading the position data of the calibration hole matched with the end diameter of the tool to be calibrated relative to the first mark; The calibration pose data of the end of the tool to be calibrated relative to the second marker is obtained according to the third pose data and the pose data of the calibration hole matched with the diameter of the end of the tool to be calibrated relative to the first marker.
2. The calibration method according to claim 1, characterized in that: The second posture data includes initial second posture data and multiple sets of rotated second posture data. The initial second posture data is used to indicate the posture data of the second identifier relative to the sensor module when the tool to be calibrated is in an initial position, and the multiple sets of rotated second posture data are used to indicate the posture data of the second identifier relative to the sensor module when the tool to be calibrated is rotated at different angles in the calibration slot.
3. The calibration method according to claim 2, characterized in that: Calibrating the tool to be calibrated according to the first posture data and the second posture data includes: Obtaining fourth posture data of the first marker relative to the second marker at the initial position according to the first posture data and the initial second posture data, the fourth posture data comprising position data of the first marker relative to the second marker at the initial position and posture data of the first marker relative to the second marker at the initial position; Reading the position data of the calibration slot relative to the first marker; Obtaining the posture data of the end of the tool to be calibrated relative to the first mark according to the multiple sets of rotational second posture data and the posture data of the calibration groove relative to the first mark; The calibration posture data of the end of the tool to be calibrated relative to the second marker is obtained according to the posture data of the end of the tool to be calibrated relative to the first marker and the fourth posture data.
4. The calibration method according to claim 3, characterized in that: Obtaining the posture data of the end of the tool to be calibrated relative to the first mark according to the multiple sets of rotational second posture data and the posture data of the calibration groove relative to the first mark, including: Fitting the multiple sets of rotated second posture data by the least square method to obtain posture data of the end of the tool to be calibrated relative to the sensor module; The posture data of the end of the tool to be calibrated relative to the first marker is obtained according to the posture data of the end of the tool to be calibrated relative to the sensor module and the first posture data.
5. The calibration method according to any one of claims 1 to 4, characterized in that: The method further comprises: reading and verifying the position data of the groove relative to the first mark; Placing the end of the tool to be calibrated against the verification groove, and acquiring the position and posture data of the first mark relative to the sensor module and the position and posture data of the second mark relative to the sensor module through the sensor module; Obtaining the position data of the verification groove relative to the sensor module according to the position data of the verification groove relative to the first mark and the position data of the first mark relative to the sensor module; Obtaining the position data of the verification groove relative to the second mark according to the position data of the verification groove relative to the sensor module and the position data of the second mark relative to the sensor module; The error of the marking pose data is determined according to the pose data of the verification groove relative to the second mark.
6. A storage medium, characterized in that: The storage medium stores a computer program, and when the processor executes the computer program, the method according to any one of claims 1 to 5 is implemented.
