An intelligent assisted navigation system for improving the safety of urological surgery

Abstract

The present invention relates to the technical field of surgical auxiliary navigation, and particularly relates to an intelligent auxiliary navigation system for improving the safety of urological surgery. The present invention determines the instrument area of the urinary tract tomographic image according to the change trend of the instrument matching situation in the same organ area in the urinary tomographic image during each analysis period; determines the instrument attitude deviation moment according to the deviation degree of the instrument area of the urinary tract tomographic image at each moment and its adjacent moment, and determines the tissue extrusion moment according to the change degree of the same kind of tactile data during each analysis period; and then assists the navigation of the surgical instrument according to the correlation between the instrument attitude deviation moment and the tissue extrusion moment. The present invention conducts a correlation analysis on the instrument deviation and tissue extrusion, real-time monitors the real-time extrusion situation of the surgical instrument on the tissue during the operation, timely gives an early warning to the surgical instrument, and thereby improves the safety of urological surgery.

Description

Technical Field

[0001] The present invention relates to the technical field of surgical operation auxiliary navigation, and in particular to an intelligent auxiliary navigation system for improving the safety of urological surgery. Background Art

[0002] Urological surgery includes radical prostatectomy, percutaneous nephrolithotomy and partial nephrectomy. Laparoscopy is a commonly used surgical method in urological surgery, especially in kidney, prostate and bladder surgery. Minimally invasive surgery brings significant advantages, such as reducing pain, shortening recovery time and reducing complications. By introducing artificial intelligence technology, it is possible to more accurately identify the location and anatomical structure of lesions, effectively avoid important blood vessels and nerves, reduce the incidence of surgical errors and complications, shorten the operation time, and significantly improve the safety of surgery.

[0003] Minimally invasive surgery uses an endoscope to provide vision and clarity for the penetration of surgical instruments, but it cannot fully reflect the position and posture of surgical instruments, causing the instruments themselves to deviate from the predetermined path during penetration and squeeze other tissues. In robot-assisted surgical navigation, the robot system relies on preoperative images and high-precision robotic arm control to achieve navigation, but the real-time tissue deformation monitoring capability during surgery is limited, making it difficult to dynamically feedback the interaction status between instruments and tissues; in multimodal image fusion navigation, ultrasound tracking of three-dimensional deformation of soft tissues still has delays, and cannot reflect the tissue squeezing status caused by instrument operation in real time; resulting in insufficient monitoring of real-time squeezing of tissues by surgical instruments during surgery, thereby reducing the safety of urological surgery. Summary of the invention

[0004] In order to solve the technical problem that the real-time monitoring capability of surgical instruments on tissue compression during surgery is insufficient, the purpose of the present invention is to provide an intelligent auxiliary navigation system that improves the safety of urological surgery. The technical solutions adopted are as follows:

[0005] The present invention proposes an intelligent auxiliary navigation system for improving the safety of urological surgery, the system comprising:

[0006] A data acquisition module, used to respectively acquire urinary tract tomographic images and different types of tactile data of the instrument in real time;

[0007] An instrument region selection module is used to determine the instrument region of the urinary tract tomographic image at each moment according to the changing trend of the instrument matching situation of the same organ region in the urinary tract tomographic image within the analysis period at each moment;

[0008] An offset extrusion analysis module is used to determine the instrument attitude offset moment according to the offset degree of the instrument area in the urinary tract tomographic images at each moment and its adjacent moments; and determine the tissue extrusion moment according to the change degree of the same tactile data within the analysis period at each moment.

[0009] An instrument-assisted navigation module is used to assist instrument navigation in urological surgery according to the correlation between the instrument attitude offset moment and the tissue extrusion moment.

[0010] Further, the determination of the instrument area in the urinary tract tomographic image at each moment includes:

[0011] Determine the organ area in the urinary tract tomographic image;

[0012] Obtain the instrument matching degree of the organ area according to the difference between the area of the overlapping part of the organ area in the urinary tract tomographic image and the instrument template and the maximum area length;

[0013] Denote the accumulated sum of the differences in the instrument matching degrees of the same organ area between all adjacent two moments within the analysis period at each moment as the instrument trend index of each organ area in the urinary tract tomographic image at each moment;

[0014] Calculate the accumulated sum of the differences in the instrument matching degrees of each organ area in the urinary tract tomographic image at each moment with the other organ areas respectively as the instrument significance index corresponding to each organ area;

[0015] Obtain the instrument possible index of each organ area in the urinary tract tomographic image at each moment according to the instrument trend index and the instrument significance index; select the instrument area from the urinary tract tomographic image based on the instrument possible index.

[0016] Further, the determination of the instrument attitude offset moment includes:

[0017] Determine the feature points of the instrument area in the urinary tract tomographic image;

[0018] Perform optical flow tracking on the feature points of the urinary tract tomographic image, and denote the concentration value of the angles between the line segments formed by every two feature points among all the feature points in the urinary tract tomographic image of the previous moment at each moment and the line segments formed by the corresponding optical flow matching points of every two feature points in the urinary tract tomographic image at each moment as the direction offset index at each moment;

[0019] Denote the concentration value of the absolute values of the differences between the distances of every two feature points among all the feature points in the urinary tract tomographic image of the previous moment at each moment and the distances of the corresponding optical flow matching points of every two feature points in the urinary tract tomographic image at each moment as the distance offset index at each moment;

[0020] Obtain the instrument offset index at each moment according to the direction offset index and the distance offset index; determine the instrument attitude offset moment based on the instrument offset index.

[0021] Further, the determining the tissue extrusion moment includes:

[0022] Calculate the cumulative sum of the differences between each moment and the same type of tactile data at all moments within its analysis period to obtain the enhancement index of each type of tactile data at each moment;

[0023] Obtain the instantaneous change index of each type of tactile data at each moment according to the difference between each type of tactile data at each moment and its tactile preset value, and the enhancement index;

[0024] Normalize the product of the instantaneous change indexes of all types of tactile data at each moment to obtain the tactile anomaly index at each moment; determine the tissue extrusion moment based on the tactile anomaly index.

[0025] Further, the assisting in instrument navigation during urological surgery according to the correlation between the instrument attitude offset moment and the tissue extrusion moment includes:

[0026] Perform a negative correlation mapping on the time interval between each tissue extrusion moment and its previous tissue extrusion moment, and normalize the product of the mapping result and the time interval between each tissue extrusion moment and its adjacent previous instrument attitude offset moment to obtain the warning coefficient at each tissue extrusion moment;

[0027] Adjust the machine at the tissue extrusion moment when the warning coefficient is greater than the preset warning threshold.

[0028] Further, the selecting the instrument area from the urinary tract tomographic image based on the instrument possible index includes:

[0029] Record the organ area corresponding to the largest instrument possible index in the urinary tract tomographic image as the instrument area.

[0030] Further, the determining the instrument attitude offset moment based on the instrument offset index includes:

[0031] Record the moment when the instrument offset index is greater than the preset offset threshold as the instrument attitude offset moment.

[0032] Further, the determining the tissue extrusion moment based on the tactile anomaly index includes:

[0033] Record the moment when the tactile anomaly index is greater than the preset tactile threshold as the tissue extrusion moment.

[0034] Further, the method for determining the feature points of the instrument area in the urinary tract tomographic image is the Harris algorithm.

[0035] Further, the central value is the mean value.

[0036] The present invention has the following beneficial effects:

[0037] In the embodiment of the present invention, the instrument is real-time positioned through the real-time urinary tract tomographic image during the surgical procedure to determine the instrument area; the attitude deviation is analyzed respectively through the deviation degree of the instrument area, and the abnormal touch of the instrument is analyzed through the real-time feature change degree of the same kind of tactile data to determine the moment of instrument attitude deviation and the moment of tissue extrusion; since there is a causal relationship between the mechanical attitude deviation and the extrusion of tissue blood vessels, the correlation between the moment of instrument attitude deviation and the moment of tissue extrusion is analyzed in real time to predict the extrusion risk of the instrument operation on the tissue during the operation, improve the intraoperative feedback mechanism and optimize the automated decision-making ability, assist the relevant personnel in instrument navigation, and effectively improve the navigation safety in urological surgery. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions and advantages in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings required for the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0039] Figure 1 It is the system structure diagram of an intelligent auxiliary navigation system for improving the safety of urological surgery provided by an embodiment of the present invention;

[0040] Figure 2 It is the schematic diagram of a computer device of an intelligent auxiliary navigation device for improving the safety of urological surgery provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0041] In order to further elaborate on the technical means and effects adopted by the present invention to achieve the intended invention purpose, the following will, in conjunction with the drawings and preferred embodiments, describe in detail the specific implementation manners, structures, features and effects of an intelligent auxiliary navigation system for improving the safety of urological surgery proposed according to the present invention. In the following description, different "one embodiment" or "another embodiment" do not necessarily refer to the same embodiment. In addition, the specific features, structures or characteristics in one or more embodiments can be combined in any suitable form.

[0042] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the technical field to which the present invention belongs.

[0043] The following specifically describes the specific solution of an intelligent assisted navigation system for improving the safety of urological surgery provided by the present invention in conjunction with the accompanying drawings.

[0044] Example 1:

[0045] Please refer to Figure 1 , which shows the system block diagram of an intelligent assisted navigation system for improving the safety of urological surgery provided by an embodiment of the present invention. The system includes: a data acquisition module 110, an instrument area selection module 120, an offset extrusion analysis module 130, and an instrument assisted navigation module 140.

[0046] The data acquisition module 110 is used to respectively and real-time obtain different types of tactile data of the urinary tract tomographic image and the instrument.

[0047] Each component of the urinary system is mainly located in the abdominal area of the human body. In order to more accurately and comprehensively measure the real-time state of the surgical instrument during the penetration process, a computed tomography (CT) scanner is used to take tomographic images of the abdomen of the patient to be measured, which is recorded as the urinary tract tomographic image; the urinary tract tomographic image provides detailed cross-sectional images of the urinary system and can clearly show the position and penetration state of the surgical instrument. At the same time, a plurality of integrated sensors are arranged on the surface of the surgical instrument, and all types of tactile data at each moment are real-time collected through the sensors. Combining the real-time penetration situation of the surgical instrument with the tactile feedback characteristics to give early warnings of operation risks and assist the surgical instrument to real-time adjust the penetration path.

[0048] If the surgical instrument squeezes tissues and blood vessels, the pressure and temperature applied to the sensor will change, and slight compression or movement of the tissue will cause a change in acceleration. Then, in the embodiment of the present invention, the sensors integrated on the surgical instrument include a pressure sensor, a temperature sensor, and an acceleration sensor, and the types of tactile data include: pressure data, temperature data, and acceleration data.

[0049] It should be noted that the sampling frequencies of the urinary tract tomographic image and the tactile data are the same. In this embodiment, the sampling frequency is set to once per second, and the implementer can set it according to the specific situation. The urinary tract tomographic images at different moments are tomographic images of the same position of the abdomen of the patient to be measured. Before performing urological surgery, it is necessary to perform three-dimensional reconstruction on the tomographic images of different positions of the abdomen of the patient to be measured to obtain a three-dimensional model of the urinary system, determine the positions of blood vessels, nerves, and lesions, and the doctor designs the penetration path of the surgical instrument from the surgical incision position to the lesion position according to experience. During the operation, the surgical instrument penetrates into the lesion position according to the penetration path. Among them, a multi-planar image reconstruction algorithm is selected for three-dimensional reconstruction.

[0050] The instrument area selection module 120 is configured to determine the instrument area of each urinary tract tomographic image according to the change trend of the instrument matching situation in the same organ area in the urinary tract tomographic image during the analysis period at each moment.

[0051] In the initial stage of the surgical operation, the penetration depth of the surgical instrument is relatively shallow, and only a small part of the instrument exists in the urinary tract tomographic image. As the instrument penetrates deeper, the doctor will insert the surgical instrument into the corresponding organ, so that the surgical instrument will gradually appear completely in the corresponding organ area in the urinary tract tomographic image. The more complete the surgical instrument appears in the organ area, the greater the instrument matching degree of the organ area. Therefore, the instrument matching degree in the same organ area shows a gradually increasing trend during a period of time, and the possibility of the surgical instrument appearing in the organ area is greater, and then the instrument area is determined.

[0052] Preferably, in some possible implementation manners of the embodiments of the present invention, the method for obtaining the instrument area includes: determining the organ area of the urinary tract tomographic image; obtaining the instrument matching degree of the organ area according to the difference between the area of the overlapping part of the organ area of the urinary tract tomographic image and the instrument template and the maximum area length; recording the cumulative sum of the differences in the instrument matching degrees of the same organ area at all adjacent two moments during the analysis period at each moment as the instrument trend index of each organ area of the urinary tract tomographic image at each moment; calculating the cumulative sum of the differences in the instrument matching degrees of each organ area of the urinary tract tomographic image at each moment with the remaining organ areas as the instrument significant index corresponding to each organ area; obtaining the instrument possible index of each organ area of the urinary tract tomographic image at each moment according to the instrument trend index and the instrument significant index; and selecting the instrument area from the urinary tract tomographic image based on the instrument possible index.

[0053] During the surgical process, each tissue and organ will not change significantly in the urinary tract tomographic image. In the embodiments of the present invention, a neural network is used to obtain an organ area corresponding to each organ in the abdomen in the urinary tract tomographic image. Since the surgical instruments in the urinary system are generally long and narrow, the length of the surgical instrument is an important feature for analyzing the matching degree between the organ area and the surgical instrument. If the difference in the maximum area length between the organ area and the instrument template is smaller and the area of the overlapping part is larger, it means that the shapes of the organ area and the surgical instrument are more similar, and the possibility that the organ area is the surgical instrument is greater, and then the instrument matching degree is greater. Therefore, there is a positive correlation between the area of the overlapping part of the organ area of the urinary tract tomographic image and the instrument template and the instrument matching degree, and there is a negative correlation between the absolute value of the difference in the maximum area length between the organ area of the urinary tract tomographic image and the instrument template and the instrument matching degree. For each organ area of the urinary tract tomographic image, the instrument matching degree Z of the organ area is expressed by the formula:

[0054] ;

[0055] In the formula, is the area of the overlapping part between the organ region and the instrument template; L is the maximum region length of the organ region; is the maximum region length of the instrument template; is the absolute value function; is a preset positive number, taking the empirical value 0.01, which is used to prevent the fraction from being meaningless due to the denominator being zero. It should be noted that the maximum region length of the instrument template refers to the maximum region length of the instrument region in the instrument template.

[0056] The method for obtaining the instrument template is as follows: Obtain the urinary tract tomographic image when the surgical instrument reaches the same lesion position as the patient to be measured during the historical operation, use semantic segmentation to remove the irrelevant regions, and take the remaining instrument region as the instrument template. It should be noted that the images are collected using the same device, so that the size of the urinary tract tomographic image is the same as that of the instrument template, and the two can be in the same coordinate system, enabling the analysis of the overlapping part between the organ region of the urinary tract tomographic image and the instrument template.

[0057] In one implementation manner of the embodiment of the present invention, the method for determining the maximum region length of the region is as follows: Obtain the minimum circumscribed rectangle of the region, and take the length of the minimum circumscribed rectangle as the maximum region length of the region.

[0058] If the instrument trend index and the instrument significant index are larger, it indicates that the upward trend of the instrument matching degree of the same organ region in the urinary tract tomographic image within each analysis period at each moment is more obvious, and the instrument matching degree of each organ region in the urinary tract tomographic image at each moment is larger compared to other organ regions. Then, the possibility of a surgical instrument appearing in each organ region is greater, and the instrument probability index is larger. Therefore, both the instrument significant index and the instrument trend index have a positive correlation with the organ probability index. In the embodiment of the present invention, the sum value of the instrument trend index and the instrument significant index of each organ region in the urinary tract tomographic image at each moment is normalized to obtain the instrument probability index of the corresponding organ region.

[0059] In the embodiment of the present invention, the correlation relationship between the instrument trend index, the instrument significant index, and the instrument probability index can also be constructed through other basic mathematical operations, such as multiplication, which will not be limited and elaborated here.

[0060] In a specific implementation manner of the embodiment of the present invention, the instrument probability index of the organ region is expressed by the formula:

[0061] ;

[0062] In the formula, is the instrument probability index of the a-th organ region in the urinary tract tomographic image at each moment; M is the total number of moments within each analysis period at each moment; is the instrument matching degree of the a-th organ region in the urinary tract tomographic image at the m-th moment within the analysis period for each moment; is the instrument matching degree of the a-th organ region in the urinary tract tomographic image at the (m + 1)-th moment within the analysis period for each moment; N is the total number of organ regions in the urinary tract tomographic image for each moment; is the instrument matching degree of the a-th organ region in the urinary tract tomographic image for each moment; is the instrument matching degree of the n-th organ region other than the a-th organ region in the urinary tract tomographic image for each moment; is the instrument trend index of the a-th organ region in the urinary tract tomographic image for each moment; is the instrument significance index of the a-th organ region in the urinary tract tomographic image for each moment; Norm is the normalization function. It should be noted that the same organ region in different urinary tract tomographic images represents the same organ.

[0063] Select the organ region corresponding to the largest instrument possibility index in the urinary tract tomographic image for each moment as the instrument region to complete the real-time positioning of the surgical instrument.

[0064] In a specific implementation manner of the embodiment of the present invention, each moment is the last moment within its analysis period, and the analysis period contains 5 moments.

[0065] The offset extrusion analysis module 130 is used to determine the instrument attitude offset moment according to the offset degree of the instrument regions in the urinary tract tomographic images of each moment and its adjacent moment; and determine the tissue extrusion moment according to the change degree of the same kind of tactile data within the analysis period of each moment.

[0066] During the surgical process, the staff needs to operate the surgical instrument to gradually penetrate into the lesion site. The surgical instrument may deviate from the predetermined path during the penetration process, resulting in squeezing other tissues and blood vessels. By analyzing the offset degree of the instrument region and the tactile feedback situation, the instrument attitude offset moment and the tissue extrusion moment are determined, so as to perform risk alarms.

[0067] Preferably, in some possible implementation manners of the embodiments of the present invention, the method for obtaining the instrument attitude offset moment includes: determining the feature points of the instrument area in the urinary tract tomographic image; performing optical flow tracking on the feature points of the urinary tract tomographic image, and taking the concentration value of the included angles between the line segments formed by every two of all the feature points in the urinary tract tomographic image at the previous moment of each moment and the line segments formed by the corresponding optical flow matching points of every two feature points in the urinary tract tomographic image at each moment as the direction offset index at each moment; taking the concentration value of the absolute values of the differences between the distances between every two of all the feature points in the urinary tract tomographic image at the previous moment of each moment and the distances between the corresponding optical flow matching points of every two feature points in the urinary tract tomographic image at each moment as the distance offset index at each moment; obtaining the instrument offset index at each moment according to the direction offset index and the distance offset index; and determining the instrument attitude offset moment based on the instrument offset index.

[0068] Generally, the surgical instrument will penetrate into the lesion position in a fixed attitude. The change in the advancing attitude of the surgical instrument indicates that it may deviate, and then the relative positions of the feature points in the instrument area will change. The deviation degree of the surgical instrument is determined by the change degrees of the directions and distances of the line segments formed by different feature points at adjacent moments. If the differences in the included angles and lengths between the line segments formed by every two of all the feature points in the urinary tract tomographic image at the previous moment of each moment and the line segments formed by the corresponding optical flow matching points of every two feature points in the urinary tract tomographic image at each moment are smaller, the attitude deviation degree of the instrument area at each moment is smaller, and the instrument offset index is smaller. Therefore, there is a positive correlation between the direction offset index, the distance offset index, and the instrument offset index. In the embodiments of the present invention, the product of the direction offset index and the distance offset index at each moment is normalized to obtain the instrument offset index. In the embodiments of the present invention, the Norm function is used for normalization. In the embodiments of the present invention, other normalization methods can also be selected, such as function transformation, maximum-minimum normalization, etc. The normalization method is not limited herein.

[0069] In the embodiments of the present invention, the correlation between the direction offset index, the distance offset index, and the instrument offset index can also be constructed through other basic mathematical operations. The construction method is not limited and will not be elaborated herein.

[0070] It should be noted that indicators such as mean, median, and mode can all reflect the central level of a set of data. The overall deviation degree of the instrument area is analyzed through the deviation degrees of pairwise feature points. In the embodiments of the present invention, the concentration value is the mean, and the mean can also be replaced by indicators such as median or mode.

[0071] In an embodiment of the present invention, the Harris algorithm is selected to obtain feature points in the urinary tract tomographic image, and the Lucas-Kanade method is used for optical flow tracking; in other embodiments, corner detection algorithms such as the Shi-Tomasi algorithm can also be selected to select feature points, and optical flow algorithms such as the Horn-Schunck optical flow algorithm are used for optical flow tracking.

[0072] The greater the instrument offset index, the greater the possibility of attitude offset of the surgical instrument at that moment. The moment when the instrument offset index is greater than the preset offset threshold is recorded as the instrument attitude offset moment.

[0073] In an implementation manner of an embodiment of the present invention, the preset offset threshold is set to 0.9, and the implementer can set it according to specific circumstances.

[0074] During the operation, if the surgical instrument exerts pressure on tissues and blood vessels, the pressure and temperature on the surface of the surgical instrument gradually increase, and the tissues will undergo slight compression or movement. Especially at the moment of initial contact or pressure application, it will cause an instantaneous increase in acceleration. Therefore, according to the degree of change of the same kind of tactile data within a period of time, it is determined whether the surgical instrument squeezes the tissue at each moment, and then the tissue squeezing moment is determined.

[0075] Preferably, in some possible implementation manners of an embodiment of the present invention, the method for obtaining the tactile anomaly index includes: calculating the cumulative sum of the differences between each moment and all moments within its analysis period of the same kind of tactile data to obtain the enhancement index of each kind of tactile data at each moment; according to the difference between each kind of tactile data at each moment and its tactile preset value, and the enhancement index, obtaining the instantaneous change index of each kind of tactile data at each moment; normalizing the cumulative product of the instantaneous change indexes of all kinds of tactile data at each moment to obtain the tactile anomaly index at each moment.

[0076] If the difference between each moment and the moments within its analysis period of the same kind of tactile data is greater, the improvement degree of each kind of tactile data is more significant, and the degree of change is greater; the tactile preset value is the normal value of each kind of tactile data. If the difference between the tactile data at each moment and the normal value is greater, and each kind of tactile data changes more compared with the normal value, then the tactile feedback of the surgical instrument at each moment is more abnormal. Therefore, the difference between each kind of tactile data at each moment and its tactile preset value, and the enhancement index are both positively correlated with the instantaneous change index. By comprehensively analyzing the changes of all kinds of tactile data, the tactile anomaly degree of the surgical instrument at each moment can be analyzed more accurately, and the tactile anomaly index can be obtained. It should be noted that in an embodiment of the present invention, the tactile preset value of each kind of tactile data is set to the tactile data of each kind when the surgical instrument just enters the body of the patient to be tested.

[0077] In a specific implementation manner of an embodiment of the present invention, the tactile anomaly index is expressed by the formula:

[0078] ;

[0079] Wherein, C is the tactile abnormality index at each moment; K is the number of types of tactile data; is the k-th type of tactile data at each moment; is the tactile preset value of the k-th type of tactile data; is the instantaneous change index of the k-th type of tactile data at each moment; M is the total number of moments within the analysis period at each moment; is the k-th type of tactile data at the m-th moment other than the last moment within the analysis period at each moment; is the enhancement index of the k-th type of tactile data at each moment.

[0080] The greater the tactile abnormality index of the surgical instrument, the greater the possibility of squeezing the body tissue at that moment. The moments when the tactile abnormality index is greater than the preset tactile threshold are recorded as tissue squeezing moments.

[0081] In an implementation manner of the embodiment of the present invention, the preset tactile threshold is set to 0.9, and the implementer can set it according to specific circumstances.

[0082] The instrument-assisted navigation module 140 is used to assist in instrument navigation during urological surgery according to the correlation between the instrument attitude deviation moment and the tissue squeezing moment.

[0083] The purpose of this solution is to give an early warning of the situation where tissue squeezing is caused by the deviation of the surgical instrument during the surgical process. However, it is not certain that the abnormal deviation of the surgical instrument will necessarily cause tissue squeezing, nor is it certain that the squeezing of other tissues is necessarily caused by the abnormal deviation of the surgical instrument. Therefore, it is necessary to perform a correlation analysis on the instrument attitude deviation moment and the tissue squeezing moment and give an early warning at the moment of tissue squeezing.

[0084] Preferably, in some possible implementation manners of the embodiment of the present invention, the method for obtaining the early warning coefficient includes: performing a negative correlation mapping on the time interval between each tissue squeezing moment and the previous tissue squeezing moment, and normalizing the product of the mapping result and the time interval between each tissue squeezing moment and the adjacent previous instrument attitude deviation moment to obtain the early warning coefficient of each tissue squeezing moment.

[0085] Since there is a causal relationship between the mechanical posture deviation and the tissue extrusion, with the mechanical posture deviation as the cause and the tissue extrusion as the result, and there is a sequential order between the two moments, the mechanical posture deviation and the tissue extrusion are in one-to-one correspondence and there is a delay in the occurrence time. If the time interval between the extrusion time of each tissue and the extrusion time of the previous tissue is smaller, the greater the extrusion impact on the surgical instrument at the extrusion time of each tissue from the extrusion time of the previous tissue, the greater the possibility of the surgical instrument extruding the tissue at each moment, and the greater the early warning requirement; if the time interval between the extrusion time of each tissue and the previous instrument posture deviation time adjacent to it is smaller, the greater the possibility of being in the delay between the two situations, the smaller the possibility of the surgical instrument extruding the tissue at each moment, and the smaller the early warning requirement.

[0086] In the embodiment of the present invention, the ratio of the time interval between the extrusion time of each tissue and the previous instrument posture deviation time adjacent to it to the time interval between the extrusion time of each tissue and the extrusion time of the previous tissue is normalized to obtain an early warning coefficient. The normalization process is carried out using the Norm function, and other normalization methods can also be used, which will not be elaborated here.

[0087] Since the surgical instrument will cause tissue extrusion at the tissue extrusion time when the early warning coefficient is greater than the preset early warning threshold, an early warning is given at the tissue extrusion time when the early warning coefficient is greater than the preset early warning threshold, so as to assist in reminding the staff to adjust the insertion path of the surgical instrument in real time when the surgical instrument squeezes the tissue, and to prompt the doctor to pay attention to adjusting the operation direction or force of the surgical instrument. There may be other situations during the operation that may also cause the instrument to squeeze the tissue, and this solution does not analyze the above other situations.

[0088] In an implementation manner of the embodiment of the present invention, the preset early warning threshold is set to 0.8, and the implementer can set it according to the specific situation.

[0089] To improve the safety of urological surgery, a robot such as the da Vinci surgical robot can be used to assist the doctor in performing delicate surgical operations. The robot magnifies and clearly presents the surgical field in the patient's body on the screen in front of the doctor through devices such as a high-definition 3D imaging system, and at the same time reduces the hand tremors of the doctor; through augmented reality (AR) glasses or mixed reality (MR) headsets, virtual information such as the location of the lesion and the course of blood vessels is superimposed on the real surgical field to assist the doctor in accurate positioning.

[0090] The intelligent assisted navigation system realizes the goal of "precision surgery" centered on the patient by deeply integrating the doctor's experience and the precision of the machine through the full-process support of "precision planning - real-time navigation - intelligent early warning".

[0091] So far, the present invention is completed.

[0092] Example 2:

[0093] Figure 2 This is a schematic diagram of a computer device of an intelligent auxiliary navigation device for improving the safety of urological surgery provided by an embodiment of the present invention. Exemplarily, as Figure 2 shown, the computer device includes: a memory 201, a processor 202, and a computer program 203 stored in the memory 201 and running on the processor 202. Among them, when the processor 202 executes the computer program 203, the computer device can execute any one of the intelligent auxiliary navigation systems for improving the safety of urological surgery introduced above.

[0094] In addition, an embodiment of the present application also protects a device, which may include a memory and a processor. Among them, an executable program code is stored in the memory, and the processor is used to call and execute the executable program code to execute an intelligent auxiliary navigation system for improving the safety of urological surgery provided by an embodiment of the present application.

[0095] This embodiment can divide the functions of the device according to the above method examples. For example, it can correspond to each functional module, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is illustrative, only a logical function division, and there may be other division methods in actual implementation.

[0096] It should be understood that the device provided in this embodiment is used to execute the above intelligent auxiliary navigation system for improving the safety of urological surgery, so the same effect as the above implementation method can be achieved.

[0097] In the case of adopting an integrated unit, the device may include a processing module and a storage module. Among them, when the device is applied to a device, the processing module can be used to control and manage the actions of the device. The storage module can be used to support the device to execute mutual program codes, etc.

[0098] Among them, the processing module can be a processor or a controller, which can implement or execute various exemplary logic blocks, modules, and circuits described in connection with the disclosure of the present application. The processor can also be a combination for implementing computing functions, such as including a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module can be a memory.

[0099] Example 3:

[0100] This embodiment also provides a computer-readable storage medium, in which computer program code is stored. When the computer program code runs on a computer, the computer is enabled to execute the above-mentioned related method steps to implement an intelligent auxiliary navigation system for improving the safety of urological surgery provided in the above embodiment.

[0101] Among them, the device and the computer-readable storage medium provided in this embodiment are both used to execute the corresponding system provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding system provided above, and will not be elaborated here.

[0102] It should be noted that the above order of the embodiments of the present invention is only for description and does not represent the superiority or inferiority of the embodiments. The processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0103] Each embodiment in this specification is described in a progressive manner. The same or similar parts among the embodiments can be referred to each other, and the key points of each embodiment are the differences from other embodiments.

[0104] The above are only the preferred embodiments of the present invention and are not intended to limit the present invention. Any modifications, equivalent replacements, improvements, etc. made within the principles of the present invention shall be included in the protection scope of the present invention.

Claims

1. An intelligent assisted navigation system for improving the safety of urological surgery, characterized in that, The system includes: a data acquisition module for respectively and real-time acquiring different types of tactile data of the urinary tract tomographic image and the instrument; an instrument area selection module for determining the instrument area of the urinary tract tomographic image at each moment according to the change trend of the instrument matching situation in the same organ area in the urinary tract tomographic image during the analysis period at each moment; a deviation and extrusion analysis module for determining the instrument attitude deviation moment according to the deviation degree of the instrument area of the urinary tract tomographic image at each moment and its adjacent moment; and determining the tissue extrusion moment according to the change degree of the same type of tactile data during the analysis period at each moment; an instrument-assisted navigation module for assisting instrument navigation in urological surgery according to the correlation between the instrument attitude deviation moment and the tissue extrusion moment; The determination of the instrument area of the urinary tract tomographic image at each moment includes: determining the organ area of the urinary tract tomographic image; acquiring the instrument matching degree of the organ area according to the difference between the area of the overlapping part of the organ area of the urinary tract tomographic image and the instrument template and the maximum area length; recording the cumulative sum of the differences between the instrument matching degrees of the same organ area at all adjacent two moments during the analysis period at each moment as the instrument trend index of each organ area of the urinary tract tomographic image at each moment; calculating the cumulative sum of the differences between the instrument matching degrees of each organ area of the urinary tract tomographic image at each moment and the other organ areas respectively as the instrument significance index corresponding to each organ area; acquiring the instrument possible index of each organ area of the urinary tract tomographic image at each moment according to the instrument trend index and the instrument significance index; and selecting the instrument area from the urinary tract tomographic image based on the instrument possible index; The determination of the instrument attitude deviation moment includes: determining the feature points of the instrument area of the urinary tract tomographic image; performing optical flow tracking on the feature points of the urinary tract tomographic image, and recording the concentration value of the angles between the line segments formed by every two feature points among all the feature points of the urinary tract tomographic image at the previous moment of each moment and the line segments formed by the corresponding optical flow matching points of every two feature points in the urinary tract tomographic image at each moment as the direction deviation index at each moment; recording the concentration value of the absolute values of the differences between the distances between every two feature points among all the feature points of the urinary tract tomographic image at the previous moment of each moment and the distances between the corresponding optical flow matching points of every two feature points in the urinary tract tomographic image at each moment as the distance deviation index at each moment; acquiring the instrument deviation index at each moment according to the direction deviation index and the distance deviation index; and determining the instrument attitude deviation moment based on the instrument deviation index; The determination of the tissue extrusion moment includes: calculating the cumulative sum of the differences between each moment and all moments of the same type of tactile data during its analysis period to obtain the enhancement index of each type of tactile data at each moment; acquiring the instantaneous change index of each type of tactile data at each moment according to the difference between each type of tactile data at each moment and its tactile preset value and the enhancement index; Normalize the cumulative product of the instantaneous change indicators of all types of tactile data at each moment to obtain the tactile anomaly indicator at each moment; determine the tissue compression moment based on the tactile anomaly indicator.

2. The intelligent assisted navigation system for improving the safety of urological surgery according to claim 1, characterized in that, The assisting in instrument navigation during urological surgery according to the correlation between the instrument posture deviation moment and the tissue compression moment includes: Perform a negative correlation mapping on the time interval between each tissue compression moment and the previous tissue compression moment, and normalize the product of the mapping result and the time interval between each tissue compression moment and the adjacent previous instrument posture deviation moment to obtain the warning coefficient at each tissue compression moment; Adjust the machine at the tissue compression moment when the warning coefficient is greater than the preset warning threshold.

3. An intelligent auxiliary navigation system for improving the safety of urological surgery according to claim 1, characterized in that, The selecting of the instrument area from the urinary tract tomographic image based on the possible instrument indicators includes: Record the organ area corresponding to the largest possible instrument indicator in the urinary tract tomographic image as the instrument area.

4. An intelligent auxiliary navigation system for improving the safety of urological surgery according to claim 1, characterized in that, The determining of the instrument posture deviation moment based on the instrument deviation indicator includes: Record the moment when the instrument deviation indicator is greater than the preset deviation threshold as the instrument posture deviation moment.

5. An intelligent assisted navigation system for improving the safety of urological surgery according to claim 1, characterized in that, The determining of the tissue compression moment based on the tactile anomaly indicator includes: Record the moment when the tactile anomaly indicator is greater than the preset tactile threshold as the tissue compression moment.

6. An intelligent auxiliary navigation system for improving the safety of urological surgery according to claim 1, characterized in that, The method for determining the feature points of the instrument area in the urinary tract tomographic image is the Harris algorithm.

7. An intelligent assisted navigation system for improving the safety of urological surgery according to claim 1, characterized in that, The central value is the mean value.

Images