Method and system for consistency calibration of catheter control direction and movement direction in image
By receiving calibration instructions during DSA surgery, calculating and recording the offset angle of the catheter bend direction, the problem of inconsistent catheter control direction and the image movement direction is solved, and the hand-eye coordination is improved to ensure the smooth progress of the operation.
Patent Information
- Application Number
- PCT/CN2024/090764
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-05-22
- Filing Date
- 2024-04-30
- Publication Date
- 2024-11-28
AI Technical Summary
In DSA surgery, the problem of inconsistent catheter control direction and the direction of image movement leads to inconsistency between the hands and eyes, which affects the progress of the surgery, especially when the calibration is not performed in time after switching the contrast position.
By receiving the calibration start command, calculate the current bending depth and bending direction of the catheter, set the incremental rotation angle of the bending direction until the catheter ends when the maximum bending is shown in the image, record the calibration offset angle, and apply it in subsequent control , to ensure that the joystick control direction is consistent with the motion direction of the image plane.
Accurate calibration of the catheter control direction and the image action direction after switching the projection plane is achieved, improving hand-eye coordination and ensuring the smooth progress of the operation.
Smart Images

Figure CN2024090764_28112024_PF_FP_ABST
Abstract
Description
Calibration method and system for consistency between catheter control direction and image motion direction
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] The present invention claims priority to Chinese patent application No. 202310572576.4 filed with the State Intellectual Property Office of China on May 22, 2023, entitled “Method and system for calibrating consistency between catheter control direction and image motion direction”, the entire contents of which are incorporated by reference into the present invention and constitute a part of the present invention for all purposes. Technical Field
[0003] The present invention relates to the general technical field of control or regulation systems, and in particular to a method and system for calibrating the consistency between a catheter control direction and an image motion direction. Background Art
[0004] The vascular intervention robot that supports adjustable bending catheters performs vascular intervention surgery under the guidance of real-time fluoroscopic images of DSA (digital subtraction angiography). It supports the use of joystick control to bend the catheter end, and the effect of bending in the corresponding direction is presented in the DSA image.
[0005] Because the intraoperative imaging position switches multiple times as the surgery progresses, failure to promptly calibrate the joystick control direction with the movement direction shown in the DSA image can lead to hand-eye coordination problems, affecting the surgeon's control and judgment, and thus hindering the surgical procedure. Specifically, there is a problem where the actual movement direction of the catheter controlled by the joystick is inconsistent with the direction of the catheter movement shown in the image. That is, when the joystick is pushed forward, the catheter in the image moves in a different direction. Even if the joystick's direction of movement is initially consistent with the image before switching the imaging position, if calibration is not performed after switching the imaging position, there will still be a deviation between the joystick's direction of movement and the catheter's direction in the image.
[0006] Summary of the Invention
[0007] To solve the above problems, the present invention proposes a method and system for calibrating the consistency between the catheter control direction and the image movement direction. When the imaging position is switched, the calibration offset angle is accurately calculated to ensure that the joystick control direction is consistent with the movement direction in the image plane.
[0008] In order to achieve the above object, the present invention adopts the following technical solutions:
[0009] In a first aspect, the present invention provides a method for calibrating the consistency between a catheter control direction and an image motion direction, comprising:
[0010] Receive calibration start instruction;
[0011] The current bending depth of the catheter in the image is determined according to the incremental value of the wire pulling length before and after the catheter is bent, and the bending depth incremental value is determined according to the current bending depth and the bending depth target value, so as to control the catheter to bend to the bending depth target value;
[0012] Set the incremental rotation angle of the bending direction for each cycle. Under the target bending depth value, change the bending direction according to the incremental rotation angle of the bending direction until the calibration end instruction is received, and the calibration is completed.
[0013] The angle value of the bending direction after calibration is completed is determined, and the calibration offset angle is determined according to the angle value of the bending direction, so that when the catheter bending direction is controlled next time, the angle value of the control direction and the calibration offset angle are added as the final control direction.
[0014] As an optional embodiment, the incremental value of the steel wire pulling length is obtained by: obtaining the incremental value of the steel wire pulling length according to the proportional relationship between the encoder value at the tail of the motor for controlling the bending of the catheter and the incremental value of the steel wire pulling length.
[0015] As an optional embodiment, the wire pulling length increment is: ΔL=K*(Value coder -InitValue coder ); K is the conversion ratio between the motor tail encoder value and the wire pulling length increment value; Value coder InitValue is the current encoder value at the tail of the motor; coder is the initial encoder value at the tail of the motor.
[0016] As an optional embodiment, the current bending depth is: β = (180*ΔL1) / (3.14*r*cos(α-90)); wherein β is the current bending depth; α is the current bending direction angle value; ΔL1 is the first steel wire pulling length increment; and r is the catheter radius.
[0017] As an optional embodiment, the catheter is controlled to change its bending direction between 0 and 360 degrees clockwise by increasing the bending direction rotation angle until the catheter in the image shows the maximum bending to the right of the advancing direction, at which time the calibration is completed.
[0018] As an optional embodiment, the angle value of the bending direction is: Wherein, ΔL1 is the incremental value of the first steel wire pulling length, and ΔL2 is the incremental value of the second steel wire pulling length.
[0019] As an optional embodiment, the calibration offset angle is the remainder of the angle value of the bending direction when the maximum bending is observed on the right side in the image divided by 360.
[0020] In a second aspect, the present invention provides a system for calibrating the consistency between a catheter control direction and an image motion direction, comprising:
[0021] An instruction receiving module is configured to receive a calibration start instruction;
[0022] a bending depth control module configured to determine a current bending depth of the catheter in the image based on an incremental value of the wire pulling length before and after the catheter is bent, and to determine a bending depth incremental value based on the current bending depth and a target bending depth value, thereby controlling the catheter to bend to the target bending depth value;
[0023] The bending direction control module is configured to set an incremental rotation angle of the bending direction per cycle, and change the bending direction according to the incremental rotation angle of the bending direction under a target bending depth value until a calibration end instruction is received, thereby completing the calibration;
[0024] The calibration module is configured to determine the angle value of the bending direction after calibration is completed, and determine the calibration offset angle based on the angle value of the bending direction, so that when the catheter bending direction is controlled next time, the angle value of the control direction and the calibration offset angle are added as the final control direction.
[0025] In a third aspect, the present invention provides an electronic device comprising a memory and a processor, and computer instructions stored in the memory and executed on the processor, wherein the computer instructions, when executed by the processor, perform the method described in the first aspect.
[0026] In a fourth aspect, the present invention provides a computer-readable storage medium for storing computer instructions, wherein when the computer instructions are executed by a processor, the method described in the first aspect is performed.
[0027] Compared with the prior art, the present invention has the following beneficial effects:
[0028] The present invention proposes a method and system for calibrating the consistency between the catheter control direction and the image movement direction, adding a plane calibration function. After switching the angiography position, the calibration process is executed. When the catheter end is observed in the image to show the maximum bend on the right side of the forward direction, the calibration process is terminated and the calibration offset angle is recorded. The calibration offset angle is then used in the subsequent motion control process to ensure consistency between the joystick control direction and the movement direction in the image plane. The calibration offset angle is accurately calculated to ensure hand-eye coordination during operation after switching the projection plane.
[0029] Advantages of additional aspects of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] The accompanying drawings, which constitute a part of the present invention, are used to provide a further understanding of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute improper limitations on the present invention.
[0031] FIG1 is a schematic diagram of the motion range of a universal joystick provided in Example 1 of the present invention;
[0032] FIG2 is a flow chart of a method for calibrating the consistency between the catheter control direction and the image motion direction provided in Example 1 of the present invention;
[0033] FIG3 is a schematic diagram of the catheter provided by Example 1 of the present invention showing the maximum bend on the right side of the advancing direction. DETAILED DESCRIPTION
[0034] The present invention will be further described below with reference to the accompanying drawings and embodiments.
[0035] It should be noted that the following detailed descriptions are exemplary and intended to provide further explanation of the present invention. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which the present invention belongs.
[0036] It should be noted that the terms used herein are only for describing specific embodiments and are not intended to limit exemplary embodiments according to the present invention. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should be understood that the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0037] In the absence of conflict, the embodiments of the present invention and the features thereof may be combined with each other.
[0038] Example 1
[0039] This embodiment provides a method for calibrating the consistency between a catheter control direction and an image motion direction, including:
[0040] Receive calibration start instruction;
[0041] The current bending depth of the catheter in the image is determined according to the incremental value of the wire pulling length before and after the catheter is bent, and the bending depth incremental value is determined according to the current bending depth and the bending depth target value, so as to control the catheter to bend to the bending depth target value;
[0042] Set the incremental rotation angle of the bending direction for each cycle. Under the target bending depth value, change the bending direction according to the incremental rotation angle of the bending direction until the calibration end instruction is received, and the calibration is completed.
[0043] The angle value of the bending direction after calibration is completed is determined, and the calibration offset angle is determined according to the angle value of the bending direction, so that when the catheter bending direction is controlled next time, the angle value of the control direction and the calibration offset angle are added as the final control direction.
[0044] In this embodiment, a universal joystick is used to control the bending of the catheter. The range of motion of the universal joystick is a circle as shown in FIG1 , wherein the positive direction of the X-axis corresponds to the 0° position in the bending direction;
[0045] When the universal joystick is controlled toward 0°, the end of the catheter bends to the right along the advancing direction in the fluoroscopic image plane;
[0046] When the universal joystick is bent in the 180° direction, the end of the catheter bends to the left along the advancing direction in the fluoroscopic imaging plane;
[0047] When the universal joystick is bent in the 90° direction, the end of the catheter bends to the right of the advancing direction on a plane perpendicular to the fluoroscopic image plane;
[0048] When the universal joystick is bent in the direction of 270°, the end of the catheter bends to the left of the advancing direction on a plane perpendicular to the fluoroscopic image plane;
[0049] And so on.
[0050] Therefore, when the above conditions cannot be met after switching the perspective image plane, the above response result can be obtained by adding the calibration offset angle to the originally sent joystick control signal.
[0051] In this embodiment, three steel wires are evenly distributed within the catheter, forming a 120° angle. Three corresponding motors pull the wires to varying lengths, creating distinct bends at the distal end. After each projection plane changes, a calibration command is sent, automatically executing the calibration process. A configurable cycle is also available.
[0052] As shown in FIG2 , the process of calibrating the consistency between the catheter control direction and the image motion direction is as follows:
[0053] Step 1: Monitor the calibration command signal; execute corresponding steps according to the changes of the calibration command signal;
[0054] Step 2: Determine whether the calibration command signal changes from 0 to 1. When the calibration command signal changes from 0 to 1, perform the following steps:
[0055] Step 2.1: Set the calibration offset angle to 0°; clear the previously recorded calibration offset angle for recalculation.
[0056] Step 2.2: Calculate the current bending depth. To observe the bending direction of the catheter tip in the fluoroscopic image, the catheter tip must be bent at a certain depth, rather than remaining vertical. Therefore, the current bending depth needs to be calculated. Specifically:
[0057] First, according to the proportional relationship between the encoder value at the tail of the motor that controls the bending of the catheter and the length of the steel wire after pulling, the incremental value of the pulling length of the two steel wires is obtained: ΔL1=K*(Value coder1 -InitValue coder1 ); ΔL2=K*(Value coder2 -InitValue coder2 );
[0058] Among them, L1 and L2 are the incremental values of the wire pulling length relative to the initial state, in mm; K is the conversion ratio of the motor tail encoder value to the incremental value of the wire pulling length, Value coder InitValue is the current encoder value at the tail of the motor. coder is the initial encoder value at the tail of the motor. The initial position is the encoder value of the motor of each steel wire when the catheter is kept in a vertically extended state before calibration begins.
[0059] Then, the current bending direction angle value and the current bending depth of the catheter end are obtained according to the incremental value of the wire pulling length; β=(180*ΔL1) / (3.14*r*cos(α-90));
[0060] Among them, α is the current bending direction angle value, which is 0 degrees when it is on the right side; β is the current bending depth; ΔL1 is the incremental value of the pulling length of the first steel wire, and ΔL2 is the incremental value of the pulling length of the second steel wire. Since the three steel wires are evenly distributed at 120 degrees, the pulling length of the third steel wire can be deduced when the pulling lengths of two steel wires are known; r is the radius of the catheter.
[0061] Step 2.3: Determine the bending depth increment value according to the current bending depth and the bending depth target value;
[0062] During the calibration process, the catheter end needs to be bent to 90° to facilitate observation of the bending direction. Therefore, in this embodiment, the target bending depth value is set to 90°, and the bending depth increment value = 90° - current bending depth.
[0063] Step 2.4: Based on the bending model of the wire-pulling catheter end, the bending depth increment value is converted into the target position change required by the three motors and sent to the corresponding motors to execute the action to achieve the purpose of achieving a 90° bending depth at the catheter end.
[0064] Step 2.5: Set the calibration state to the first stage; there are three calibration states: the first stage is when the calibration instruction is received; the second stage is after executing the target with a bending depth of 90°, which is used to mark the calibration program entering the motion state of 360° cyclic change in the bending direction; the uncalibrated stage is at the end of the calibration.
[0065] Step 3: If the calibration command signal does not change from 0 to 1, then determine that the calibration signal is 1 and there is no change from 0 to 1 in this cycle. If this condition is met, perform the following steps:
[0066] Step 3.1: Check whether the calibration state is the first stage. Because it takes time for the catheter to bend to 90°, when the calibration command signal is equal to 1, the calibration execution status must be confirmed to determine whether the bending depth or bending direction should be further changed.
[0067] Step 3.2: If the calibration status is the first stage, it means that the catheter has not yet bent to 90 degrees, and the current bending depth needs to be calculated. The process is the same as step 2.2. If the calibration status is the second stage, proceed to step 3.5.
[0068] Step 3.3: Determine whether the current bending depth is within the range of 90°±1°; if not, continue with step 3.2 until the catheter is bent to 90°;
[0069] Step 3.4: If step 3.3 is satisfied, the calibration status is set to the second stage, indicating that the bending depth has reached the required 90° for the calibration procedure, and step 3.5 is executed;
[0070] Step 3.5: Set the incremental rotation angle of the bending direction per cycle;
[0071] The purpose of this step is to allow the end of the consumable to change its bending direction between 0 and 360 degrees in a clockwise direction while maintaining a clearly observable bending depth (90 degrees) until the catheter is observed to have a maximum bend on the right side of the forward direction in the perspective imaging plane, as shown in Figure 3. This is convenient for the user to observe and the calibration is completed. After the calibration is completed, the calibration offset angle is obtained.
[0072] As an optional implementation, the incremental rotation angle in the bending direction of each cycle may be set to: 360° / (3000 ms / 2 ms)=0.24°.
[0073] Step 3.6: Convert the incremental rotation angle in the bending direction into the target position changes required by the three motors and send them to the corresponding motors to execute the action;
[0074] The bending direction that needs to be sent to the motor for execution is the sum of the current bending direction and the incremental rotation angle of the bending direction, and the bending depth is the target bending depth value (90° in this embodiment).
[0075] Step 4: When the calibration command signal changes from 1 to 0, perform the following steps:
[0076] Step 4.1: Use the method in step 2.2 to calculate the bending direction angle value after executing step 3.6;
[0077] Step 4.2: The calibration command signal changes from 1 to 0, indicating that the operator has observed the maximum bend on the right side of the fluoroscopic imaging catheter's forward direction. Calibration is now complete, and the bend direction angle value calculated in step 4.1 (% 360) is used as the calibration offset angle.
[0078] Step 4.3: Set the calibration status to uncalibrated; update the calibration status flag to facilitate the next calibration.
[0079] Step 4.4: When the catheter is bent the next time, the angle value of the control direction and the calibration offset angle are added together to form the final control direction, so that the control direction of the joystick is consistent with the movement direction under the fluoroscopic image.
[0080] Example 2
[0081] This embodiment provides a system for calibrating the consistency between a catheter control direction and an image motion direction, comprising:
[0082] An instruction receiving module is configured to receive a calibration start instruction;
[0083] a bending depth control module configured to determine a current bending depth of the catheter in the image based on an incremental value of the wire pulling length before and after the catheter is bent, and to determine a bending depth incremental value based on the current bending depth and a target bending depth value, thereby controlling the catheter to bend to the target bending depth value;
[0084] The bending direction control module is configured to set an incremental rotation angle of the bending direction per cycle, and change the bending direction according to the incremental rotation angle of the bending direction under a target bending depth value until a calibration end instruction is received, thereby completing the calibration;
[0085] The calibration module is configured to determine the angle value of the bending direction after calibration is completed, and determine the calibration offset angle based on the angle value of the bending direction, so that when the catheter bending direction is controlled next time, the angle value of the control direction and the calibration offset angle are added as the final control direction.
[0086] It should be noted that the above modules correspond to the steps described in Example 1, and the examples and application scenarios implemented by the above modules and the corresponding steps are the same, but are not limited to the contents disclosed in the above Example 1. It should be noted that the above modules, as part of the system, can be executed in a computer system such as a set of computer-executable instructions.
[0087] In further embodiments, there is also provided:
[0088] An electronic device includes a memory and a processor, and computer instructions stored in the memory and executed by the processor, wherein when the computer instructions are executed by the processor, the method described in Example 1 is performed. For the sake of brevity, no further details are given here.
[0089] It should be understood that in this embodiment, the processor may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), off-the-shelf field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.
[0090] The memory may include a read-only memory and a random access memory, and provides instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory. For example, the memory may also store device type information.
[0091] A computer-readable storage medium is used to store computer instructions, and when the computer instructions are executed by a processor, the method described in Example 1 is performed.
[0092] The method in Example 1 can be directly implemented as a hardware processor, or can be implemented using a combination of hardware and software modules in the processor. The software module can be located in a storage medium mature in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, etc. The storage medium is located in the memory, and the processor reads the information in the memory and, in conjunction with its hardware, completes the steps of the above method. To avoid repetition, it will not be described in detail here.
[0093] Those skilled in the art will appreciate that the units, i.e., algorithm steps, of the various examples described in conjunction with this embodiment can be implemented using electronic hardware or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0094] Although the above describes the specific embodiments of the present invention in conjunction with the accompanying drawings, it is not intended to limit the scope of protection of the present invention. Those skilled in the art should understand that various modifications or variations that can be made by those skilled in the art on the basis of the technical solution of the present invention without any creative work are still within the scope of protection of the present invention.
Claims
1. A method for calibrating the consistency between the catheter control direction and the image motion direction, characterized in that: include: Receive a calibration start instruction; According to the incremental value of the wire pulling length before and after the catheter is bent, the current bending depth of the catheter in the image is determined, and the incremental value of the bending depth is determined according to the current bending depth and the bending depth target value, so as to control the catheter to bend to the bending depth target value; The incremental rotation angle of the bending direction of each cycle is set. Under the target value of the bending depth, the bending direction is changed according to the incremental rotation angle of the bending direction until the calibration end instruction is received, and the calibration is completed; Determine the angle value of the bending direction after the calibration is completed, and determine the calibration offset angle according to the angle value of the bending direction, so that when the catheter bending direction is controlled next time, the angle value of the control direction and the calibration offset angle are added as the final control direction; The current bending depth is: β=(180*ΔL1) / (3.14*r*cos(α-90)); The angle value of the bending direction is: Wherein, β is the current bending depth; α is the current bending direction angle value; ΔL1 is the incremental value of the first steel wire pulling length; r is the catheter radius; ΔL2 is the incremental value of the second steel wire pulling length; The calibration offset angle is the remainder of the angle value in the bending direction divided by 360; The catheter is controlled to change its bending direction between 0° and 360° clockwise by increasing the bending direction increment angle until the catheter in the image shows the maximum bending on the right side of the advancing direction, at which point the calibration is completed.
2. The method for calibrating the consistency between the catheter control direction and the image motion direction according to claim 1, characterized in that: The wire pulling length increment value is obtained by: obtaining the wire pulling length increment value according to the proportional relationship between the motor tail encoder value for controlling the catheter bending and the wire pulling length increment value.
3. The method for calibrating the consistency between the catheter control direction and the image motion direction according to claim 2, characterized in that: The wire pulling length increment is: ΔL = K*(Value coder -InitValue coder ); where K is the conversion ratio between the motor tail encoder value and the wire pulling length increment value; Value coder InitValue is the current encoder value at the end of the motor; coder is the initial encoder value at the tail of the motor.
4. A system for calibrating the consistency between the catheter control direction and the image motion direction, characterized in that: The method for completing any one of claims 1 to 3 specifically comprises: An instruction receiving module is configured to receive a calibration start instruction; A bending depth control module is configured to determine the current bending depth of the catheter in the image according to the incremental value of the wire pulling length before and after the catheter is bent, and determine the incremental value of the bending depth according to the current bending depth and the bending depth target value, so as to control the catheter to bend to the bending depth target value; The bending direction control module is configured to set the bending direction incremental rotation angle of each cycle, and change the bending direction according to the bending direction incremental rotation angle under the bending depth target value, until the calibration is completed after receiving the calibration end instruction; The calibration module is configured to determine the angle value of the bending direction after the calibration is completed, and determine the calibration offset angle according to the angle value of the bending direction, so that when the catheter bending direction is controlled next time, the angle value of the control direction and the calibration offset angle are added as the final control direction.
5. An electronic device, characterized in that: The method comprises a memory and a processor and computer instructions stored in the memory and executed on the processor, wherein when the computer instructions are executed by the processor, the method according to any one of claims 1 to 3 is completed.
6. A computer-readable storage medium, characterized in that: Used to store computer instructions, which, when executed by a processor, complete the method described in any one of claims 1 to 3.
Citation Information
Patent Citations
Medical device
CN102573600A
Manipulator and medical system
CN107847110A
Control method, system and computer readable storage medium of in-vivo introduction device
CN112336297A
Catheter bending steering control method, catheter system and storage medium
CN115715839A
Interventional robot catheter bending control method, system and equipment and storage medium
CN115844544A
