A needle placement system, a needle placement real-time display method, and a computer-readable storage medium

By using a needle placement system and real-time display method, and processing medical images with electrical signals and deep neural networks, the real-time visualization of the puncture needle position is achieved, solving the problem of uncertain positioning during puncture and improving the safety and accuracy of puncture.

CN114533212BActive Publication Date: 2024-11-22HANGZHOU SANTAN MEDICAL TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202011359655.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-11-27
Publication Date
2024-11-22
Estimated Expiration
2040-11-27

AI Technical Summary

Technical Problem

In existing technologies, the puncture process relies on blind manual operation, which leads to uncertainty in the positioning of the puncture needle and catheter, increasing the difficulty of puncture.

Method used

The needle placement system includes a needle placement unit, a guiding motion unit, a signal acquisition unit, an image acquisition unit, and a display unit. It processes medical images through electrical signal calculation and a deep neural network model to achieve real-time visualization of the puncture needle position.

Benefits of technology

It improves the safety and accuracy of the puncture procedure, reduces reliance on the anesthesiologist's clinical experience, and ensures precise control of the puncture needle position.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114533212B_ABST
    Figure CN114533212B_ABST
Patent Text Reader

Abstract

The present invention relates to a needle placement system and a needle placement real-time display method, and a computer-readable storage medium. The needle placement system includes: a needle placement unit, a guide motion unit, a signal acquisition unit, an image acquisition unit, a display unit, and a control unit; the image acquisition unit is used to receive and process the medical image of the needle placement object to obtain a lateral image with tissue structure and tissue structure boundary identification; the display unit is used to receive and display the lateral image; the guide motion unit is used to drive the needle placement unit to place the needle at the target point of the needle placement object; the signal acquisition unit is used to obtain the electrical signal fed back by the needle placement unit, and calculate the position of the needle tip in the needle placement unit according to the electrical signal; the control unit is used to obtain the electrical signal to control the guide motion unit, and send the position of the needle tip in the needle placement unit to the display unit and display it superimposed on the lateral image. The present invention realizes the visualization of the puncture process and has high safety.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of medical devices, and in particular to a needle placement system, a needle placement real-time display method, and a computer-readable storage medium. Background Art

[0002] The current puncture method used in clinical practice is still blind manual operation. Doctors rely on subjective perception to identify the puncture position and are unable to obtain the puncture position intuitively, which makes the positioning of the puncture needle and catheter uncertain, resulting in great difficulty in puncture. Summary of the invention

[0003] The object of the present invention is to provide a needle placement system, a needle placement real-time display method, and a computer-readable storage medium.

[0004] To achieve the above-mentioned object of the invention, the present invention provides a needle placement system, comprising: a needle placement unit, a guiding motion unit, a signal acquisition unit, an image acquisition unit, a display unit and a control unit respectively connected to the image acquisition unit, the guiding motion unit, the needle placement unit, the signal acquisition unit and the display unit;

[0005] The needle placement unit is mounted on the guiding motion unit, and the signal acquisition unit is connected to the needle placement unit;

[0006] The image acquisition unit is used to receive and process the medical image of the needle-placed object to obtain a lateral image with tissue structure and tissue structure boundary markers;

[0007] The display unit is used to receive and display the lateral image;

[0008] The guiding motion unit is used to drive the needle placement unit to place the needle at the target point of the needle placement object;

[0009] The signal acquisition unit is used to obtain the electrical signal fed back by the needle placement unit, and calculate the position of the needle tip in the needle placement unit according to the electrical signal;

[0010] The control unit is used to obtain the electrical signal to control the guiding motion unit, and to send the position of the needle tip in the needle placement unit to the display unit and display it superimposed on the lateral image.

[0011] According to one aspect of the present invention, the needle placement unit includes: a first support for interconnecting with the guide motion unit, a second support slidably connected to the first support, a needle placement assembly slidably connected to the second support, and a first drive arranged on the first support for driving the second support to move.

[0012] According to one aspect of the present invention, the needle placement assembly is provided with a pressure sensor;

[0013] Along the moving direction of the needle placement assembly, a first limiter that can abut against the pressure sensor and a second limiter for limiting the moving position of the needle placement assembly are relatively arranged on the second support.

[0014] According to one aspect of the present invention, the needle placement assembly further includes: a third support for sliding connection with the second support, a fourth support for detachably connecting with the third support, and a puncture needle mounted on the fourth support.

[0015] According to one aspect of the present invention, the puncture needle comprises a puncture portion and a needle core portion;

[0016] The puncture part is a hollow cylindrical body, and the needle core part is detachably arranged coaxially with the puncture part in the hollow part of the puncture part;

[0017] The fourth support is provided with an electrical conductor for electrically connecting the signal acquisition unit and the puncture part to each other;

[0018] An insulating layer is arranged on the outer surface of the puncture portion.

[0019] According to one aspect of the present invention, the lateral image is a combined image of a medical image of the tissue in the depth direction and superimposed with a tissue boundary line, or the lateral image is a color image based on a medical image of the tissue in the depth direction and using different color areas to divide different tissue structures.

[0020] According to one aspect of the present invention, the image acquisition unit is provided with a deep neural network model for processing the medical image.

[0021] According to one aspect of the present invention, the electrical signal collected in real time by the signal acquisition unit includes at least one of needle displacement data, resistance monitoring data, electrophysiological monitoring data, and digital feature recognition data of puncture tissue differentiation; wherein,

[0022] The needle insertion displacement data is used to reflect the theoretical distance moved by the needle tip in the needle placement unit;

[0023] The resistance monitoring data is used to reflect the real-time changes in resistance during the needle placement process;

[0024] Electrophysiological monitoring data, used to reflect changes in electrophysiological data at the needle tip;

[0025] The digital feature recognition data of the punctured tissue differentiation is used to reflect the conductivity of the needle tip location.

[0026] To achieve the above-mentioned object of the invention, the present invention provides a method for real-time display of needle placement, comprising:

[0027] S1. Acquire a medical image of the object for needle placement, and process the medical image based on the image acquisition unit to obtain a lateral image with tissue structure and tissue structure boundary identification;

[0028] S2. Obtaining the target point of the needle placement object, and guiding the motion unit to guide the needle placement unit to the target point;

[0029] S3. driving the needle placement unit to advance in the puncture direction, the signal acquisition unit to collect electrical signals in real time, and calculate the position of the needle tip of the needle placement unit according to the collected electrical signals;

[0030] S4. Display the position of the puncture needle in real time in the lateral image.

[0031] According to one aspect of the present invention, it also includes:

[0032] S5. The control unit obtains a deviation value between the electrical signal and standard data in a standard database, and if the deviation value exceeds a preset threshold, a prompt is given in the lateral image.

[0033] According to one aspect of the present invention, the lateral image is a combined image of a medical image of the tissue in the depth direction and superimposed with a tissue boundary line, or the lateral image is a color image based on a medical image of the tissue in the depth direction and using different color areas to divide different tissue structures.

[0034] According to one aspect of the present invention, the deep neural network model is generated based on the following steps:

[0035] S11. Obtain medical images of multiple needle-placed objects and mark the tissue structures as training samples;

[0036] S12. Input the training samples into the deep neural network for training to obtain the deep neural network model.

[0037] According to one aspect of the present invention, it also includes:

[0038] S13. Acquire medical images of multiple new needle placement objects as test samples;

[0039] S14. Inputting the test sample into the deep neural network model, and outputting a lateral image with a tissue structure boundary line;

[0040] S15. Determine the position accuracy of the tissue structure boundary line in the lateral image, and if the position accuracy is higher than a threshold, output the deep neural network model.

[0041] According to one aspect of the present invention, in step S1, in the step of acquiring the medical image of the needle placement object, at least one of a magnetic resonance image, a CT image, a DR image, an ultrasound image, and an X-ray image is used to acquire the image.

[0042] To achieve the above-mentioned object of the invention, the present invention provides a computer-readable storage medium having computer instructions stored thereon, which, when executed by a processor, implement the steps of the above-mentioned needle placement real-time display method.

[0043] According to a solution of the present invention, the visualization of the puncture process is realized, and the real-time display of the electrical signal on the simulation graph ensures the operator's accurate judgment and grasp of the entire puncture process, thereby improving the safety of the puncture process.

[0044] According to one solution of the present invention, the present invention uses a variety of monitoring methods combined with real-time display of lateral images to make the determination of the puncture process more reliable and accurate.

[0045] According to one solution of the present invention, the puncture depth can be accurately controlled through visualized images without relying on the clinical experience of the anesthesiologist.

[0046] According to one solution of the present invention, the boundary between adjacent tissue structures can be clearly expressed in the lateral image, so that the position of the puncture needle tip during the puncture process of the needle placement unit can be accurately displayed on the lateral image. Moreover, the lateral image with clear boundaries makes it easier for the operator to intuitively and accurately obtain the insertion depth of the puncture needle. Especially at the junction of different tissues, when the electrical signal fed back by the needle placement unit 1 is prone to jump or unresponsive, the corresponding position information can be intuitively obtained from the lateral image with clear boundaries, which allows the operator to make judgments and operations more easily and accurately, making the entire needle placement process smoother and safer.

[0047] According to a solution of the present invention, it can be achieved that different tissue structures on the lateral image can correspond one to one with the actual medical image, and the boundary lines of each tissue structure can be displayed in the same horizontal direction on the display unit. In this way, while the puncture needle position is displayed in real time on the lateral image, the operator can compare and judge with the actual medical image. When the electrical signal fed back by the needle placement unit is prone to jump or insensitive reaction, the operator can grasp the puncture needle position more accurately, which is beneficial to ensuring the safety of the entire puncture process. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] Figure 1 is a structural diagram schematically showing a needle placement system according to an embodiment of the present invention;

[0049] Figure 2is a structural diagram schematically showing a needle placement unit according to an embodiment of the present invention;

[0050] Figure 3 is an exploded view schematically showing a needle placement unit according to an embodiment of the present invention;

[0051] Figure 4 A structural diagram schematically shows a puncture needle for a puncture process according to an embodiment of the present invention. DETAILED DESCRIPTION

[0052] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments are briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0053] When describing the embodiments of the present invention, the orientation or positional relationship expressed by the terms "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside" and "outside" are based on the orientation or positional relationship shown in the relevant drawings and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the referred device or element must have a specific orientation, be constructed and operate in a specific orientation. Therefore, the above terms should not be understood as limiting the present invention.

[0054] The present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments. The embodiments cannot be described one by one here, but the embodiments of the present invention are not therefore limited to the following embodiments.

[0055] like Figure 1 As shown, according to one embodiment of the present invention, a needle placement system of the present invention comprises: a needle placement unit 1, a guiding motion unit 2, a signal acquisition unit, an image acquisition unit, a display unit 4 and a control unit 3 connected to the image acquisition unit, the guiding motion unit, the needle placement unit, the signal acquisition unit and the display unit respectively. In this embodiment, the needle placement unit 1 is mounted on the guiding motion unit 2, and the signal acquisition unit is connected to the needle placement unit 1.

[0056] In this embodiment, the image acquisition unit is used to receive and process the medical image of the needle placement object to obtain a lateral image with tissue structure and tissue structure boundary identification; in this embodiment, the medical image of the needle placement object is acquired by at least one of magnetic resonance images, CT images, DR images, ultrasound images, and X-ray images. In this embodiment, the lateral image is a medical image of the tissue in the depth direction and a combined image superimposed with a tissue boundary line, or the lateral image is a color image based on the medical image of the tissue in the depth direction and using different color areas to divide different tissue structures. In this embodiment, a deep neural network model for processing medical images is provided in the image acquisition unit, and the input medical image is automatically converted into a lateral image for display through the deep neural network model.

[0057] In this embodiment, the display unit is used to receive and display the lateral image.

[0058] In this embodiment, the guiding motion unit 2 is used to drive the needle placement unit 1 to place the needle at the target point of the needle placement object;

[0059] In this embodiment, the signal acquisition unit is used to obtain the electrical signal fed back by the needle placement unit, and calculate the position of the needle tip in the needle placement unit 1 according to the electrical signal;

[0060] In this embodiment, the control unit 3 is used to obtain electrical signals to control the guiding motion unit 2, and to send the position of the needle tip in the needle placement unit 1 to the display unit 4 and display it superimposed on the lateral image.

[0061] Combination Figure 1 , Figure 2 , Figure 3 As shown, according to one embodiment of the present invention, the needle placement unit 1 includes: a first support 11 for interconnecting with the guide motion unit 2, a second support 12 slidably connected to the first support 11, a needle placement assembly 13 slidably connected to the second support 12, and a first drive 14 disposed on the first support 11 for driving the second support 12 to move. In this embodiment, the control unit 3 can control the guide motion unit 2 to drive the needle placement unit 1 to perform the puncture operation, thereby realizing the automation of the puncture process.

[0062] Combination Figure 2 , Figure 3 As shown, according to one embodiment of the present invention, the moving direction of the needle placement assembly 13 on the second support 12 is parallel to the moving direction of the second support 12 on the first support 11 .

[0063] Combination Figure 2 , Figure 3As shown, according to one embodiment of the present invention, the first drive 14 drives the second support 12 to move linearly back and forth on the first support 11. The needle placement assembly 13 moves linearly back and forth on the second support 12, and the needle placement assembly 13 and the second support 12 are driven by a non-powered element. In this embodiment, the first drive 14 includes: a power source 141 and a screw nut pair 142. The first drive 14 can be formed by connecting a stepper motor to a screw nut pair to form a linear drive device, which is integrated between the main shaft of the stepper motor and the screw nut pair. Of course, the first drive 14 can also be directly implemented by an integral drive device such as an electric cylinder. Through the above-mentioned arrangement, the main shaft of the stepper motor is a ball screw, so that when the motor drives the screw to rotate, traditional components such as couplings are reduced in the middle, which effectively reduces the volume and moment of inertia of the electric first drive, and improves the response speed of the first drive 14.

[0064] Combination Figure 2 , Figure 3 As shown, according to one embodiment of the present invention, the needle placement assembly 13 is provided with a pressure sensor 131. In this embodiment, along the moving direction of the needle placement assembly 13, a first limit 121 that can abut against the pressure sensor 131 and a second limit 122 for limiting the moving position of the needle placement assembly 13 are relatively provided on the second support 12. In this embodiment, when the first drive 14 drives the second support 12 to move forward, if the needle placement assembly 13 is subjected to resistance in front, and then the needle placement assembly 13 moves backward under the action of the resistance until the pressure sensor 131 abuts against the first limit 121, at this time, the first drive 14 continues to drive the second support 12 to move forward, and the pressure sensor 131 converts the received resistance into an electrical signal and outputs it to the control unit 3, and then the change in resistance encountered by the needle placement assembly 13 during the puncture process can be known through the conversion of the control unit 3. When the first drive 14 drives the second support 12 to move backward, if the needle placement assembly 13 encounters friction resistance in the opposite direction of movement, the needle placement assembly 13 moves in the direction close to the second limit position 122, and then abuts against the second limit position 122. The first drive 14 continues to drive the second support 12 to move backward. Under the abutment of the second limit position 122, the resistance encountered by the needle placement assembly 13 can be easily overcome, so that it continues to move backward with the first drive 14.

[0065] Combination Figure 2 , Figure 3As shown, according to one embodiment of the present invention, the needle placement assembly 13 also includes: a third support 132 for sliding connection with the second support 12, a fourth support 133 for detachably connecting with the third support 132, and a puncture needle 134 installed on the fourth support 133. In this embodiment, the third support 132 is snap-connected with the fourth support 133; the puncture needle 134 is snap-connected with the fourth support 133. Through the above arrangement, the third support 132, the fourth support 133 and the puncture needle 134 can be easily disassembled and replaced, thereby improving the efficiency of disassembly and replacement. At the same time, the positioning accuracy is higher by adopting the snap-connection method, which is beneficial to ensuring the puncture accuracy of the present invention.

[0066] Combination Figure 2 , Figure 3 As shown, according to one embodiment of the present invention, the third support 132 is slidably connected to the second support 12 via a sliding guide rail. The fourth support 133 includes a connecting plate 1331 and a supporting plate 1332 that are vertically arranged. In this embodiment, the connecting plate 1331 is snap-connected to the third support 132, and the puncture needle 134 is snap-connected to the supporting plate 1332. In this embodiment, the supporting plate 1332 is located on one side of the connecting plate 1331, and then the puncture needle 134 and the supporting plate 1332 are located on the same side of the connecting plate 1331.

[0067] Combination Figure 2 , Figure 3 As shown, according to one embodiment of the present invention, a sound detection module 1231 is provided on the fourth support 133. In this embodiment, the sound detection module 1231, the puncture needle 134 and the support plate 1332 are located on the same side of the connecting plate 1331. The sound detection module 1231 is directly mounted on the surface of the connecting plate 1331, and the sound detection module 1231 and the puncture needle 134 are spaced apart from each other along the thickness direction of the connecting plate 1331.

[0068] Combination Figure 2 , Figure 3 As shown, according to an embodiment of the present invention, the puncture needle 134 includes a puncture portion 1341 and a needle core portion 1342. In this embodiment, the puncture portion 1341 is a hollow cylindrical body, and the needle core portion 1342 is detachably arranged coaxially with the puncture portion 1341 in the hollow part of the puncture portion 1341. The needle core portion 1342 is a solid cylindrical body. By inserting the needle core portion 1342 into the puncture portion 1341, the hollow part of the puncture portion 1341 can be blocked, thereby ensuring that the puncture portion 1341 of the puncture needle 134 is not connected to the external environment during the puncture process. When the needle core portion 1342 needs to be removed, it is only necessary to clamp one end of the needle core portion 1342 and pull it out of the puncture portion 1341.

[0069] Combination Figure 2 , Figure 3 As shown, in this embodiment, one end of the needle core part 1342 is provided with a first structural member 1342a, and the end of the puncture part 1341 adjacent to the first structural member 1342a is adjacent to the sound detection module 1231. In this embodiment, by providing the first structural member 1342a on the needle core part 1342, the needle core part 1342 inserted into the puncture part 1341 can be easily pulled out. In addition, by the abutment of the first structural member 1342a and the puncture part 1341, the sealing effect of the needle core part 1342 on the hollow part of the puncture part 1341 can be effectively improved, thereby ensuring the use performance of the present invention.

[0070] Combination Figure 2 , Figure 3 As shown, according to an embodiment of the present invention, an electric conductor for electrically connecting the control unit 3 and the puncture part 1341 is provided on the fourth support 133; an insulating layer is provided on the outer surface of the puncture part 1341. In this embodiment, the insulating layer is a Teflon coating. In this embodiment, the puncture part 1341 is made of a metal material, and the insulating layer is provided on its surface to effectively achieve the effect that the needle end of the puncture part 1341 is conductive and other parts are insulated. At the same time, the use of the Teflon coating has the effect of lubrication, etc., so that the puncture effect of the present invention is better. In this embodiment, by providing an electric conductor for electrically connecting the control unit 3 and the puncture part 1341 on the fourth support 133, electrophysiological monitoring of the puncture position is achieved. Specifically, when the puncture part 1341 touches the nerve root, the electrical signal at the needle end will stimulate the nerve, so that the control unit 3 can obtain the corresponding electrophysiological monitoring signal.

[0071] According to one embodiment of the present invention, the electrical signal collected in real time by the signal acquisition unit includes at least one of needle displacement data, resistance monitoring data, electrophysiological monitoring data, and digital feature recognition data for differentiation of punctured tissue; wherein the needle displacement data is used to reflect the theoretical distance moved by the needle tip in the needle placement unit 1; the resistance monitoring data is used to reflect the real-time changes in resistance during the needle placement process; the electrophysiological monitoring data is used to reflect changes in the electrophysiological data of the needle tip; and the digital feature recognition data for differentiation of punctured tissue is used to reflect the conductivity of the needle tip position.

[0072] According to one embodiment of the present invention, a real-time display method for needle placement of the present invention includes:

[0073] S1. Obtain a medical image of the object for needle placement, and process the medical image based on a deep neural network model to obtain a lateral image having the same tissue structure as the medical image and having a tissue structure boundary mark;

[0074] S2. Obtaining the target point of the needle placement object, and guiding the motion unit to guide the needle placement unit to the target point;

[0075] S3. The needle placement unit 1 is driven to advance in the puncture direction, and the signal acquisition unit collects electrical signals in real time, and calculates the position of the needle tip of the needle placement unit according to the collected electrical signals;

[0076] S4. Display the position of the puncture needle in real time in the lateral image.

[0077] According to one embodiment of the present invention, in step S1, the position of the object is determined by the counter-pointer, and then the object is subjected to medical imaging based on the determined position to obtain a corresponding medical image. In this embodiment, the acquired medical image is input into a trained deep neural network model, and the medical image is processed based on the deep neural network model to obtain a lateral image with tissue structure and tissue structure boundary identification. In this embodiment, the lateral image is a medical image of the tissue in the depth direction and a combined image superimposed with a tissue boundary line, or the lateral image is a color image based on the medical image of the tissue in the depth direction and using different color regions to divide different tissue structures.

[0078] Through the above settings, the boundaries between adjacent tissue structures can be clearly expressed in the lateral image, so that the position of the puncture needle tip during the puncture process of the needle placement unit can be accurately displayed on the lateral image. Moreover, the lateral image with clear boundaries makes it easier for the operator to intuitively and accurately obtain the puncture needle depth. Especially when the electrical signal fed back by the needle placement unit 1 is prone to jumps or unresponsiveness, the corresponding position information can be intuitively obtained from the lateral image with clear boundaries, which allows the operator to make judgments and operations more easily and accurately, making the entire needle placement process smoother and safer.

[0079] According to one embodiment of the present invention, the lateral image and the medical image are displayed side by side on the display unit 4 in equal proportions.

[0080] Through the above settings, it can be achieved that different tissue structures on the lateral image can correspond to the actual medical image one by one, and the boundary lines of each tissue structure can be displayed in the same horizontal direction on the display unit. In this way, while the puncture needle position is displayed in real time on the lateral image, the operator can compare and judge with the real medical image. When the electrical signal fed back by the needle placement unit 1 is prone to jump or insensitive reaction, the operator can grasp the puncture needle position more accurately, which is beneficial to ensure the safety of the entire puncture process.

[0081] According to one embodiment of the present invention, in step S2, the target point of the needle placement object is obtained, and the control unit 3 controls the guide motion unit 2 to guide the needle placement unit 1 to the target point. After the system calibration is completed, an X-ray film of the target position of the needle placement object is obtained through a C-arm X-ray machine, and intraoperative image positioning is performed to obtain the target area, and the target point in the target area is further selected. After the target point is selected, the control unit 3 drives the guide motion unit 2 to move according to the selected target point, so that the guide motion unit 2 aligns the posture of the needle placement unit connected to it with the target point, and then waits for the subsequent puncture operation.

[0082] According to one embodiment of the present invention, in step S3, after the needle placement unit 1 moves to the target position, the guiding motion unit 2 drives the puncture needle 134 on the needle placement unit 1 to advance in the puncture direction, and feeds back the obtained electrical signal to the control unit 3, and the control unit 3 processes the electrical signal and transmits it to the display unit 4 and superimposes it on the lateral image. In this embodiment, the electrical signal includes at least one of the needle displacement signal, the resistance change signal, the electrophysiological monitoring signal, and the puncture tissue differentiation signal, which means that the electrical signal obtained by the control unit 3 contains at least two signals (needle displacement signal and other signals). In this embodiment, the control unit 3 can display the end of the puncture needle in the form of a dot (of course, it can also be other shapes or forms, as long as it is easy to identify) on the lateral image, and the control unit can change the position of the dot in real time on the image based on the needle displacement signal to achieve real-time changes in the displacement of the puncture needle. In addition, the control unit also marks these electrical signals at the dot position in the form of data, and as the dot position changes, the data of these electrical signals are also updated in real time with the feedback of the needle placement unit.

[0083] In this embodiment, the resistance change signal is acquired by the pressure sensor 131, the needle displacement signal is acquired by the first driver 14, and the electrophysiological monitoring signal and the puncture tissue differentiation signal are acquired by the puncture needle.

[0084] In this embodiment, after the puncture needle enters the skin, the pulse number of the stepper motor is recorded by a counter provided in the device, thereby obtaining in real time a needle displacement signal after the puncture needle enters the skin.

[0085] See also Figure 4 As shown, in this embodiment, the end of the puncture needle of the present invention is conductive, and the other end of the puncture needle is connected to the interface of the sensor, so that the puncture needle can achieve real-time acquisition of electrophysiological monitoring signals and can be displayed on the lateral image.

[0086] In this embodiment, the electrical conductivity of different tissues can be collected by combining the electrical signal fed back by muscle electrical stimulation in the aforementioned electrophysiological monitoring signal acquisition process, and then superimposed on the lateral image for real-time display.

[0087] like Figure 1 As shown, according to one embodiment of the present invention, the needle placement real-time display method of the present invention further includes:

[0088] S5. The control unit obtains the deviation value between the electrical signal and the standard data in the standard database. If the deviation value exceeds a preset threshold, a prompt is given in the lateral image.

[0089] According to an embodiment of the present invention, in step S5, during the process of issuing an alarm, the lateral image and the corresponding position of the medical image are synchronously enlarged and displayed based on the position of the puncture needle.

[0090] According to one embodiment of the present invention, in step S4, in the step of displaying the position of the puncture needle in real time in the lateral image, the puncture path of the needle placement unit 1 is fitted based on the electrical signal, and the puncture path is superimposed on the lateral image and displayed.

[0091] Through the above settings, the real-time data displayed on the image can be made more intuitive and accurate.

[0092] According to one embodiment of the present invention, the deep neural network model in step S1 is generated based on the following steps:

[0093] S11. Obtain medical images of multiple needle-placed objects and mark the tissue structures as training samples;

[0094] S12. Input the training samples into the deep neural network for training to obtain a deep neural network model;

[0095] S13. Acquire medical images of multiple new needle placement objects as test samples;

[0096] S14. Input the test sample into the deep neural network model, and output a lateral image with a tissue structure boundary line;

[0097] S15. Determine the position accuracy of the tissue structure boundary line in the lateral image, and if the position accuracy is higher than a threshold, output a deep neural network model.

[0098] By using a deep neural network model to process and judge medical images, the distribution of each tissue structure becomes clearer, allowing the operator to focus on the signal changes when the puncture needle passes through different tissue structures, reducing the operator's labor intensity.

[0099] According to the present invention, the visualization of the puncture process is realized, and the real-time display of the electrical signal on the simulation graph ensures that the operator can accurately judge and grasp the entire puncture process, thereby improving the safety of the puncture process.

[0100] According to one embodiment of the present invention, a computer-readable storage medium of the present invention stores computer instructions, which, when executed by a processor, implement the steps of the aforementioned needle placement real-time display method.

[0101] The above contents are merely examples of specific solutions of the present invention. For devices and structures not described in detail therein, it should be understood that they can be implemented by adopting general devices and general methods available in the art.

[0102] The above is only one solution of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A needle placement system, characterized in that: include: A needle placement unit, a guiding motion unit, a signal acquisition unit, an image acquisition unit, a display unit, and a control unit connected to the image acquisition unit, the guiding motion unit, the needle placement unit, the signal acquisition unit, and the display unit, respectively; The needle placement unit is mounted on the guiding motion unit, and the signal acquisition unit is connected to the needle placement unit; The image acquisition unit is used to receive and process a medical image of a needle placement object to obtain a lateral image with tissue structure and tissue structure boundary markers; the image acquisition unit is provided with a deep neural network model for processing medical images; the lateral image is a combined image of a medical image of the tissue in the depth direction and superimposed with a tissue boundary line, or the lateral image is a color image based on a medical image of the tissue in the depth direction and divided into different color regions for different tissue structures; The display unit is used to receive and display the lateral image; the display unit displays the lateral image and the medical image in parallel in equal proportions; The guiding motion unit is used to drive the needle placement unit to place the needle at the target point of the needle placement object; The signal acquisition unit is used to obtain the electrical signal fed back by the needle placement unit, and calculate the position of the needle tip in the needle placement unit according to the electrical signal; The control unit is used to obtain the electrical signal to control the guiding motion unit, and send the position of the needle tip in the needle placement unit to the display unit and display it superimposed on the lateral image; The deep neural network model is generated based on the following steps: S11. Obtain medical images of multiple needle-placed objects and mark the tissue structures as training samples; S12. Input the training samples into the deep neural network for training to obtain the deep neural network model; S13. Acquire medical images of multiple new needle placement objects as test samples; S14. Inputting the test sample into the deep neural network model, and outputting a lateral image with a tissue structure boundary line; S15. Determine the position accuracy of the tissue structure boundary line in the lateral image, and if the position accuracy is higher than a threshold, output the deep neural network model.

2. The needle placement system according to claim 1, characterized in that: The needle placement unit includes: a first support for interconnecting with the guide motion unit, a second support slidably connected to the first support, a needle placement assembly slidably connected to the second support, and a first drive arranged on the first support for driving the second support to move.

3. The needle placement system according to claim 2, characterized in that: The needle placement assembly is provided with a pressure sensor; Along the moving direction of the needle placement assembly, a first limiter that can abut against the pressure sensor and a second limiter for limiting the moving position of the needle placement assembly are relatively arranged on the second support.

4. The needle placement system according to claim 3, characterized in that: The needle placement assembly further includes: a third support for sliding connection with the second support, a fourth support for detachably connecting with the third support, and a puncture needle mounted on the fourth support.

5. The needle placement system according to claim 4, characterized in that: The puncture needle comprises a puncture part and a needle core part; The puncture part is a hollow cylindrical body, and the needle core part is detachably arranged coaxially with the puncture part in the hollow part of the puncture part; The fourth support is provided with an electrical conductor for electrically connecting the signal acquisition unit and the puncture part to each other; An insulating layer is arranged on the outer surface of the puncture portion.

6. The needle placement system according to claim 1, characterized in that: The electrical signal collected in real time by the signal acquisition unit includes at least one of needle displacement data, resistance monitoring data, electrophysiological monitoring data, and digital feature recognition data of puncture tissue differentiation; wherein, The needle insertion displacement data is used to reflect the theoretical distance moved by the needle tip in the needle placement unit; The resistance monitoring data is used to reflect the real-time changes in resistance during the needle placement process; Electrophysiological monitoring data, used to reflect changes in electrophysiological data at the needle tip; The digital feature recognition data of the punctured tissue differentiation is used to reflect the conductivity of the needle tip location.

7. A needle placement real-time display method for the needle placement system according to any one of claims 1 to 6, comprising: S1. Acquire a medical image of the object for needle placement, and process the medical image based on the image acquisition unit to obtain a lateral image with tissue structure and tissue structure boundary identification; S2. Obtaining the target point of the needle placement object, and guiding the motion unit to guide the needle placement unit to the target point; S3. driving the needle placement unit to advance in the puncture direction, the signal acquisition unit to collect electrical signals in real time, and calculate the position of the needle tip of the needle placement unit according to the collected electrical signals; S4. Display the position of the puncture needle in real time in the lateral image.

8. The method for real-time display of needle placement according to claim 7, characterized in that: Also includes: S5. The control unit obtains a deviation value between the electrical signal and standard data in a standard database, and if the deviation value exceeds a preset threshold, a prompt is given in the lateral image.

9. The method for real-time display of needle placement according to claim 7, characterized in that: In step S1, in the step of obtaining the medical image of the needle placement object, at least one of a magnetic resonance image, a CT image, a DR image, an ultrasound image, and an X-ray image is used to obtain the medical image.

10. A computer-readable storage medium, characterized in that: Computer instructions are stored thereon, and when the instructions are executed by a processor, the steps of the needle placement real-time display method as described in any one of claims 7 to 9 are implemented.