CT-assisted ultrasonic bone imaging method and device
By combining CT images and ultrasound technology, intensity compensation and time delay correction of ultrasound images are solved, and the problem of unclear bone structure and radiation risks in ultrasound imaging are achieved, clear real-time ultrasound bone imaging is achieved, and surgical navigation is improved. Accuracy and safety.
Patent Information
- Application Number
- CN202411214101.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-31
- Publication Date
- 2024-12-03
AI Technical Summary
In the prior art, ultrasound imaging is difficult to accurately present the internal structural details of the bone, and CT imaging has radiation risks and static properties, which limits its application in surgical navigation.
By acquiring preoperative three-dimensional CT images, the tissue density data, sound velocity data and sound attenuation coefficient are calculated, and combined with the real-time position information and parameter data of the ultrasound probe, the intensity compensation and time delay correction of the ultrasound image are carried out to generate clear real-time ultrasound bone imaging.
It improves the accuracy and safety of surgical navigation, overcomes the problems of phase distortion and intensity attenuation in ultrasound imaging, and is suitable for real-time imaging needs, improving the effectiveness and success rate of the surgery.
Smart Images

Figure CN119055277A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of medical image processing, and in particular to a CT-assisted ultrasonic bone imaging method and device. Background Art
[0002] With the continuous development of medical imaging technology, image-guided surgical navigation has become an indispensable and important tool in modern surgery. This technology relies on advanced medical imaging computing and computer image processing technology. It helps clinicians to plan surgical paths and simulate surgeries by accurately segmenting, identifying, reconstructing and visualizing medical images obtained before surgery. This process not only improves the safety and effectiveness of surgery, but also improves the accuracy of surgery, especially in the positioning and treatment of complex lesions.
[0003] In modern medical imaging technology, ultrasound imaging and computed tomography (CT) are two widely used technologies, each with its own strengths. Ultrasound imaging is widely used in soft tissue observation and some intraoperative navigation due to its radiation-free, real-time imaging and low cost. However, since ultrasound waves will undergo phase distortion when passing through bones or other high-density structures, this phenomenon makes it difficult for ultrasound to accurately present the structural details inside the bones, limiting its application in bone tissue imaging.
[0004] Although CT imaging can provide high-resolution images of bone structures, allowing bones and their internal structures to be observed in detail. However, the limitation of CT technology is that the radiation risk to patients during its imaging process is high, so it is not suitable for frequent use. In addition, CT imaging is usually static and cannot provide real-time imaging support during surgical operations. This limitation seriously affects its application scenarios in surgical navigation, especially in complex surgical procedures that require real-time observation of dynamic changes.
[0005] Therefore, how to effectively combine the advantages of CT and ultrasound images, overcome their respective limitations, and achieve clear ultrasonic bone imaging has become an important topic in the current research of medical imaging and surgical navigation technology.
[0006] The disclosure of the above background technology content is only used to assist in understanding the concept and technical solution of the present invention. It does not necessarily belong to the prior art of this patent application. In the absence of clear evidence that the above content has been disclosed on the filing date of this patent application, the above background technology should not be used to evaluate the novelty and creativity of the present application. Summary of the invention
[0007] The present application provides a CT-assisted ultrasonic bone imaging method and device, which can generate clear ultrasonic bone imaging.
[0008] To achieve the above objectives, the present application discloses the following technical solutions:
[0009] A CT-assisted ultrasonic bone imaging method comprises the following steps:
[0010] Obtain preoperative three-dimensional CT images;
[0011] The tissue density data, the sound velocity data and the sound attenuation coefficient of each voxel point in the preoperative three-dimensional CT image are calculated based on the preset approximate linear relationship coefficient;
[0012] Acquire real-time position information and real-time orientation information of the ultrasound probe in three-dimensional space;
[0013] Acquire parameter data of ultrasound system and ultrasound probe;
[0014] Acquire real-time ultrasound images during surgery;
[0015] Perform intensity compensation and time delay correction operations on the scattered signal of each pixel point in the ultrasound image according to parameter data of the ultrasound system and ultrasound probe, tissue density data, sound velocity data, acoustic attenuation coefficient, real-time position information and real-time orientation information;
[0016] Real-time ultrasound bone imaging is generated based on the delay-corrected and intensity-compensated signals of each channel.
[0017] In an embodiment of the present application, by acquiring preoperative three-dimensional CT images, high-resolution bone structure information, including detailed bone and soft tissue structure information, can be provided.
[0018] By performing intensity compensation and time delay correction operations on the scattered signal of each pixel in the ultrasound image based on the parameter data of the ultrasound system and ultrasound probe, tissue density data, sound velocity data, acoustic attenuation coefficient, real-time position information and real-time orientation information, and then generating real-time ultrasound bone imaging based on the signals of each channel after delay correction and intensity compensation, it effectively combines the precise structural information of CT images and the dynamic characteristics of real-time ultrasound images, solves the problems of phase distortion and intensity attenuation in traditional ultrasound imaging, improves the accuracy and safety of surgical navigation, and is conducive to improving the effectiveness and success rate of surgery.
[0019] In addition, tissue density data, sound velocity data and sound attenuation coefficient are calculated based on preset approximate linear relationship coefficients, which is conducive to simplifying the calculation process, improving calculation efficiency, and meeting the needs of real-time imaging.
[0020] In some possible implementations of the first aspect, the steps of performing intensity compensation and time delay correction operations on the scattered signal of each pixel point in the ultrasound image according to parameter data of the ultrasound system and the ultrasound probe, tissue density data, sound velocity data, acoustic attenuation coefficient, real-time position information, and real-time orientation information include:
[0021] Based on the parameter data of the ultrasound system and ultrasound probe, tissue density data, sound velocity data, sound attenuation coefficient, real-time position information and real-time orientation information, the acoustic wave equation is used to simulate the propagation of ultrasound waves in bones, and the intensity attenuation coefficient diagram and phase distortion diagram of the bone structure to ultrasound waves are obtained;
[0022] According to the intensity attenuation coefficient map and the phase distortion map, a preset calculation method is applied to calculate the intensity attenuation value and phase distortion value of the scattered signal of each pixel point in the real-time ultrasound image between each array element;
[0023] According to the phase distortion value of the scattering signal of each pixel point between each array element, the time delay corresponding to the scattering signal of each pixel point in the real-time ultrasound image is calculated;
[0024] According to the time delay corresponding to the scattering signal of each pixel point, the signal of each channel is sampled to correct the time delay of the signal of each channel;
[0025] According to the intensity attenuation value of the scattered signal of each pixel between each array element, the scattered signal of each pixel is intensity compensated to correct the intensity loss.
[0026] In this way, based on the parameter data of the ultrasound system and ultrasound probe, tissue density data, sound velocity data and sound attenuation coefficient, the acoustic wave equation can be used to simulate the propagation of ultrasound in the bone, and an intensity attenuation coefficient diagram and a phase distortion diagram of the bone structure to ultrasound can be generated to quantify the attenuation degree and phase distortion of the sound wave in the bone, providing data support for the subsequent calculation of the intensity attenuation value and phase distortion value of the scattered signal of each pixel point in the ultrasound image between each array element.
[0027] According to the simulation results, the intensity attenuation value and phase distortion value of the scattered signal of each pixel in the ultrasound image between each array element are calculated, which can provide data support for the correction of the attenuation degree and phase distortion of the subsequent real-time ultrasound image. Based on the phase distortion value, the time delay corresponding to each pixel in the ultrasound image is calculated, and the ultrasound signal is corrected for time delay, which can reduce the imaging blur caused by phase distortion. According to the intensity attenuation value of the scattered signal of each pixel between each array element, the intensity compensation of each pixel can correct the signal intensity attenuation caused by the bone structure and improve the image contrast. According to the real-time ultrasound imaging after delay correction and intensity compensation, clear bone imaging can be generated, making the final imaging effect clearer, more accurate and reliable.
[0028] In some possible implementations of the first aspect, the parameter data of the ultrasound system and the ultrasound probe include center frequency, apodization, focus setting and array element size, so as to more accurately simulate the propagation of sound waves in tissues and improve the quality of real-time ultrasound bone imaging.
[0029] In some possible implementations of the first aspect, the method for generating real-time ultrasonic bone imaging based on the channel signals after delay correction and intensity compensation is: superimposing the channel signals after delay correction and intensity compensation to obtain real-time ultrasonic bone imaging; or coherently combining the channel signals after delay correction and intensity compensation to obtain real-time ultrasonic bone imaging.
[0030] In some possible implementations of the first aspect, the preset calculation method is based on a straight-line propagation tracking method or a reverse time migration method.
[0031] In some possible implementations of the first aspect, the step of acquiring real-time position information and real-time orientation information of the ultrasound probe in three-dimensional space includes:
[0032] Receiving ultrasound probe video acquired by a binocular vision system;
[0033] Obtaining first calibration parameters of the binocular vision system;
[0034] Based on the first calibration parameters and the ultrasound probe video, a binocular vision algorithm is applied to calculate the position information and orientation information of the ultrasound probe in three-dimensional space.
[0035] In this way, the position and orientation information of the ultrasound probe can be obtained in real time, providing accurate real-time data support for surgical navigation.
[0036] In a second aspect, an embodiment of the present application provides a CT-assisted ultrasonic bone imaging device, comprising:
[0037] A first acquisition module is used to acquire a preoperative three-dimensional CT image;
[0038] A first calculation module is used to calculate tissue density data, sound velocity data and sound attenuation coefficient of each voxel point in the preoperative three-dimensional CT image based on a preset approximate linear relationship coefficient;
[0039] A second acquisition module is used to acquire real-time position information and real-time orientation information of the ultrasound probe in three-dimensional space;
[0040] A third acquisition module is used to acquire parameter data of the ultrasound system and the ultrasound probe;
[0041] A fourth acquisition module is used to acquire real-time ultrasound images during surgery;
[0042] A first correction module is used to perform intensity compensation and time delay correction operations on the scattered signal of each pixel point in the ultrasound image according to parameter data of the ultrasound system and the ultrasound probe, tissue density data, sound velocity data, acoustic attenuation coefficient, real-time position information and real-time orientation information;
[0043] The first generating module is used to generate real-time ultrasonic bone imaging according to the signals of each channel after delay correction and intensity compensation.
[0044] In some possible implementations of the second aspect, the first correction module is specifically used to: based on parameter data of the ultrasound system and the ultrasound probe, tissue density data, sound velocity data, sound attenuation coefficient, real-time position information, and real-time orientation information, apply the acoustic wave equation to simulate the propagation of ultrasound waves in the bones, and obtain an intensity attenuation coefficient diagram and a phase distortion diagram of the bone structure to the ultrasound waves;
[0045] According to the intensity attenuation coefficient map and the phase distortion map, a preset calculation method is applied to calculate the intensity attenuation value and phase distortion value of the scattered signal of each pixel point in the real-time ultrasound image between each array element;
[0046] According to the phase distortion value of the scattering signal of each pixel point between each array element, the time delay corresponding to the scattering signal of each pixel point in the real-time ultrasound image is calculated;
[0047] According to the time delay corresponding to the scattering signal of each pixel point, the signal of each channel is sampled to correct the time delay of the signal of each channel;
[0048] According to the intensity attenuation value of the scattered signal of each pixel between each array element, the scattered signal of each pixel is intensity compensated to correct the intensity loss.
[0049] In some possible implementations of the second aspect, parameter data of the ultrasound system and the ultrasound probe include center frequency, apodization, focus setting, and array element size.
[0050] In some possible implementations of the second aspect, the first generating module is specifically used to: superimpose the signals of each channel after delay correction and intensity compensation to obtain real-time ultrasonic bone imaging; or perform coherence combination processing on the signals of each channel after delay correction and intensity compensation to obtain real-time ultrasonic bone imaging.
[0051] In some possible implementations of the second aspect, the preset calculation method is based on a straight-line propagation tracking method or a reverse time migration method.
[0052] In some possible implementations of the second aspect, the second acquisition module is specifically used to: receive an ultrasound probe video captured by a binocular vision system; obtain a first calibration parameter of the binocular vision system; and based on the first calibration parameter and the ultrasound probe video, apply a binocular vision algorithm to calculate the position information and orientation information of the ultrasound probe in three-dimensional space.
[0053] In a third aspect, an embodiment of the present application provides an electronic device, comprising one or more processors; a storage device on which one or more programs are stored; when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any technical solution of the first aspect.
[0054] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the method described in any technical solution of the first aspect is implemented.
[0055] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the method described in any technical solution of the first aspect.
[0056] Among them, the technical effects brought about by any design method in the second to fifth aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0057] In order to more clearly illustrate the implementation methods of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for the implementation methods or the description of the prior art. Obviously, the drawings in the following description are only exemplary, and for ordinary technicians in this field, other implementation drawings can be derived from the provided drawings without creative work.
[0058] Figure 1 A schematic flow chart of a CT-assisted ultrasonic bone imaging method provided in some embodiments of the present application;
[0059] Figure 2 A schematic diagram of the propagation path of ultrasonic sound waves emitted by an ultrasonic probe;
[0060] Figure 3 A schematic structural diagram of a CT-assisted ultrasonic bone imaging device provided in some embodiments of the present application;
[0061] Figure 4 It is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present application. DETAILED DESCRIPTION
[0062] Specific embodiments of the present invention will now be mentioned in detail. Although the present invention is described in conjunction with these specific embodiments, it should be appreciated that it is not intended to limit the present invention to these specific embodiments. On the contrary, these embodiments are intended to cover substitutions, changes or equivalent embodiments that may be included in the spirit and scope of the invention defined by the claims. In the following description, a large number of specific details are set forth in order to provide a comprehensive understanding of the present invention. The present invention may be implemented without some or all of these specific details.
[0063] When used in conjunction with "including," "methods comprising," or similar language in this specification and the appended claims, the singular forms "a," "an," and "the" include plural references unless the context clearly dictates otherwise. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
[0064] With the continuous development of medical imaging technology, image-guided surgical navigation has become an indispensable and important tool in modern surgery. This technology relies on advanced medical imaging computing and computer image processing technology. It helps clinicians to plan surgical paths and simulate surgeries by accurately segmenting, identifying, reconstructing and visualizing medical images obtained before surgery. This process not only improves the safety and effectiveness of surgery, but also improves the accuracy of surgery, especially in the positioning and treatment of complex lesions.
[0065] In modern medical imaging technology, ultrasound imaging and computed tomography (CT) are two widely used technologies, each with its own strengths. Ultrasound imaging is widely used in soft tissue observation and some intraoperative navigation due to its radiation-free, real-time imaging and low cost. This phenomenon makes it difficult for ultrasound to accurately present the structural details inside the bone, limiting its application in bone tissue imaging.
[0066] Although CT imaging can provide high-resolution images of bone structures, allowing bones and their internal structures to be observed in detail. However, the limitation of CT technology is that the radiation risk to patients during its imaging process is high, so it is not suitable for frequent use. In addition, CT imaging is usually static and cannot provide real-time imaging support during surgical operations. This limitation seriously affects its application scenarios in surgical navigation, especially in complex surgical procedures that require real-time observation of dynamic changes.
[0067] Therefore, how to effectively combine the advantages of CT and ultrasound images, overcome their respective limitations, and achieve clear ultrasonic bone imaging has become an important topic in the current research of medical imaging and surgical navigation technology.
[0068] In response to the above technical problems, the overall idea of the technical solution provided by the present application is as follows: An embodiment of the present application provides a CT-assisted ultrasonic bone imaging method, comprising the following steps: obtaining a preoperative three-dimensional CT image; calculating tissue density data, sound velocity data and acoustic attenuation coefficient of each voxel point in the preoperative three-dimensional CT image based on a preset approximate linear relationship coefficient; obtaining real-time position information and real-time orientation information of the ultrasonic probe in three-dimensional space; obtaining parameter data of the ultrasonic system and the ultrasonic probe; obtaining real-time ultrasonic images during surgery; performing intensity compensation and time delay correction operations on the scattered signals of each pixel point in the ultrasonic image according to the parameter data, tissue density data, sound velocity data, acoustic attenuation coefficient, real-time position information and real-time orientation information of the ultrasonic system and the ultrasonic probe; generating real-time ultrasonic bone imaging according to the signals of each channel after delay correction and intensity compensation.
[0069] Among them, by obtaining preoperative three-dimensional CT images, high-resolution bone structure information, including detailed bone and soft tissue structure information, can be provided. By performing intensity compensation and time delay correction operations on the scattered signal of each pixel in the ultrasound image according to the parameter data of the ultrasound system and ultrasound probe, tissue density data, sound velocity data, sound attenuation coefficient, real-time position information and real-time orientation information, and then generating real-time ultrasound bone imaging based on the signals of each channel after delay correction and intensity compensation, it effectively combines the precise structural information of CT images and the dynamic characteristics of real-time ultrasound images, solves the problems of phase distortion and intensity attenuation in traditional ultrasound imaging, improves the accuracy and safety of surgical navigation, and is conducive to improving the effectiveness and success rate of surgery. In addition, tissue density data, sound velocity data and sound attenuation coefficient are calculated based on preset approximate linear relationship coefficients, which is conducive to simplifying the calculation process, improving calculation efficiency, and is suitable for the needs of real-time imaging.
[0070] After introducing the basic principles of the present application, various non-limiting implementation methods of the present application will be specifically described below in conjunction with the drawings in the specification.
[0071] See also Figure 1 and Figure 2 The present application embodiment provides a CT-assisted ultrasonic bone imaging method, comprising the following steps:
[0072] S101: obtaining a preoperative three-dimensional CT image;
[0073] Specifically, in some embodiments, the execution entity of the CT-assisted ultrasonic bone imaging method (for example, a computer device) can be connected to a PACS (picture archiving and communication system), a hospital information system (HIS) or a radiology information system (RIS) through a wired or wireless connection to obtain three-dimensional CT images collected before surgery.
[0074] S102: Calculating tissue density data, sound velocity data, and sound attenuation coefficient of each voxel point in the preoperative three-dimensional CT image based on a preset approximate linear relationship coefficient;
[0075] Specifically: In CT images, bones and soft tissues (such as muscle and fat) usually show significant differences. This is because the grayscale value of a pixel in CT reflects the degree of X-ray attenuation of the tissue in the pixel area. Since the attenuation of bones is much higher than that of soft tissue, bones are usually displayed as bright areas in commercial CT. The basic principle of ultrasound imaging is based on the reflection of sound waves, and its intensity depends on the difference in tissue acoustic impedance (that is, the product of sound speed and density). The sound speed and density of tissues have an approximately linear relationship with the grayscale value of pixels in CT: the higher the CT value, the greater the density, the higher the sound speed, and the greater the attenuation, and vice versa.
[0076] S103: Acquire real-time position information and real-time orientation information of the ultrasound probe in three-dimensional space;
[0077] Specifically, in some embodiments, the above-mentioned execution subject may obtain the real-time position information and real-time orientation information of the ultrasound probe in three-dimensional space through the following steps:
[0078] The first step is to receive the ultrasound probe video collected by the binocular vision system;
[0079] The second step is to obtain the first calibration parameters of the binocular vision system;
[0080] The third step is to calculate the position and orientation information of the ultrasound probe in three-dimensional space based on the first calibration parameters and the ultrasound probe video using a binocular vision algorithm. In this way, the ultrasound probe position and orientation information can be obtained in real time, providing accurate real-time data support for surgical navigation.
[0081] S104: Acquire parameter data of the ultrasound system and the ultrasound probe;
[0082] Specifically, the execution subject can be connected to the terminal device by wired connection or wireless connection to obtain the parameter data of the ultrasound system and the ultrasound probe input by the staff from the terminal device. The parameter data of the ultrasound system and the ultrasound probe include but are not limited to the center frequency, apodization, focus setting and array element size.
[0083] S105: Acquire real-time ultrasound images during surgery;
[0084] Specifically, the execution subject may be connected to the ultrasound imaging system via a wired connection or a wireless connection to obtain real-time ultrasound images during surgery.
[0085] S106: performing intensity compensation and time delay correction operations on the scattered signal of each pixel point in the ultrasound image according to parameter data of the ultrasound system and the ultrasound probe, tissue density data, sound velocity data, acoustic attenuation coefficient, real-time position information, and real-time orientation information;
[0086] Specifically, the execution subject can perform intensity compensation and time delay correction operations on the scattered signal of each pixel point in the ultrasound image according to the parameter data of the ultrasound system and the ultrasound probe, tissue density data, sound velocity data, acoustic attenuation coefficient, real-time position information and real-time orientation information through the following steps:
[0087] The first step is to use the acoustic wave equation to simulate the propagation of ultrasonic sound waves in bones based on the parameter data of the ultrasonic system and ultrasonic probe, tissue density data, sound velocity data, acoustic attenuation coefficient, real-time position information and real-time orientation information, and obtain the intensity attenuation coefficient diagram and phase distortion diagram of the bone structure to the ultrasonic sound waves;
[0088] Specifically, the emission, propagation and reception of sound waves in tissues are simulated based on the acoustic wave equation. During the simulation, the space is meshed using the finite element method, and each mesh point is assigned a corresponding density, sound velocity and sound attenuation value.
[0089] The second step is to calculate the intensity attenuation value and phase distortion value of the scattered signal of each pixel point in the real-time ultrasound image between each array element according to the intensity attenuation coefficient map and the phase distortion map by using a preset calculation method;
[0090] Specifically, the preset calculation method can be based on the straight-line propagation tracking method (assuming that the propagation path is a straight line, and the bone structure on its path applies signal attenuation and delay pixel by pixel) or the reverse-time migration method (Reverse-Time Regression, simulating the emission and reception processes of sound waves respectively) to calculate the intensity attenuation and phase delay.
[0091] The third step is to calculate the time delay corresponding to the scattering signal of each pixel point in the real-time ultrasound image according to the phase distortion value of the scattering signal of each pixel point between each array element;
[0092] The fourth step is to sample the signals of each channel according to the time delay corresponding to the scattered signal of each pixel point, and correct the time delay of the signals of each channel;
[0093] The fifth step is to compensate the intensity of the scattered signal of each pixel point according to the intensity attenuation value of the scattered signal between each array element, and correct the intensity loss. In this way, the propagation of ultrasound in the bone can be simulated by applying the acoustic wave equation based on the parameter data of the ultrasound system and ultrasound probe, tissue density data, sound velocity data and sound attenuation coefficient, and the intensity attenuation coefficient diagram and phase distortion diagram of the bone structure to ultrasound can be generated to quantify the attenuation degree and phase distortion of the sound wave in the bone, and provide data support for the subsequent calculation of the intensity attenuation value and phase distortion value of the scattered signal of each pixel point in the ultrasound image between each array element.
[0094] According to the simulation results, the intensity attenuation value and phase distortion value of the scattered signal of each pixel in the ultrasound image between each array element are calculated, which can provide data support for the correction of the attenuation degree and phase distortion of the subsequent real-time ultrasound image. Based on the phase distortion value, the time delay corresponding to each pixel in the ultrasound image is calculated, and the ultrasound signal is corrected for time delay, which can reduce the imaging blur caused by phase distortion. According to the intensity attenuation value of the scattered signal of each pixel between each array element, the intensity compensation of each pixel can correct the signal intensity attenuation caused by the bone structure and improve the image contrast. According to the real-time ultrasound imaging after delay correction and intensity compensation, clear bone imaging can be generated, making the final imaging effect clearer, more accurate and reliable.
[0095] S107: Generate real-time ultrasonic bone imaging based on the signals of each channel after delay correction and intensity compensation.
[0096] Specifically, the above-mentioned execution subject can generate real-time ultrasonic bone imaging according to each channel signal after delay correction and intensity compensation in the following manner: superimpose the each channel signal after delay correction and intensity compensation to obtain real-time ultrasonic bone imaging.
[0097] Of course, the present application is not limited thereto. In other embodiments, the execution subject may also obtain real-time ultrasonic bone imaging by performing coherence combination processing on the signals of each channel after delay correction and intensity compensation.
[0098] See also Figure 3 Based on the inventive concept of a CT-assisted ultrasonic bone imaging method in the aforementioned embodiment, the embodiment of the present application provides a CT-assisted ultrasonic bone imaging device, comprising:
[0099] A first acquisition module 201 is used to acquire a preoperative three-dimensional CT image;
[0100] A first calculation module 202 is used to calculate tissue density data, sound velocity data and sound attenuation coefficient of each voxel point in the preoperative three-dimensional CT image based on a preset approximate linear relationship coefficient;
[0101] A second acquisition module 203 is used to acquire real-time position information and real-time orientation information of the ultrasound probe in three-dimensional space;
[0102] The third acquisition module 204 is used to acquire parameter data of the ultrasound system and the ultrasound probe;
[0103] The fourth acquisition module 205 is used to acquire real-time ultrasound images during surgery;
[0104] A first correction module 206, configured to perform intensity compensation and time delay correction operations on the scattered signal of each pixel point in the ultrasound image according to parameter data of the ultrasound system and the ultrasound probe, tissue density data, sound velocity data, acoustic attenuation coefficient, real-time position information and real-time orientation information;
[0105] The first generating module 207 is used to generate real-time ultrasonic bone imaging according to the delay-corrected and intensity-compensated signals of each channel.
[0106] In some embodiments, the parameter data of the ultrasound system and ultrasound probe include center frequency, apodization, focus setting, and array element size.
[0107] In some embodiments, the second acquisition module 203 is specifically used to: receive the ultrasound probe video collected by the binocular vision system; obtain the first calibration parameter of the binocular vision system; and based on the first calibration parameter and the ultrasound probe video, apply the binocular vision algorithm to calculate the position information and orientation information of the ultrasound probe in three-dimensional space.
[0108] In some embodiments, the first correction module 206 is specifically used for: based on the parameter data of the ultrasound system and the ultrasound probe, tissue density data, sound speed data, sound attenuation coefficient, real-time position information and real-time orientation information, applying the acoustic wave equation to simulate the propagation of ultrasound waves in the bones, and obtaining the intensity attenuation coefficient diagram and phase distortion diagram of the bone structure to the ultrasound waves; according to the intensity attenuation coefficient diagram and the phase distortion diagram, applying a preset calculation method to calculate the intensity attenuation value and phase distortion value of the scattering signal of each pixel point in the real-time ultrasound image between each array element; according to the phase distortion value of the scattering signal of each pixel point between each array element, calculating the time delay corresponding to the scattering signal of each pixel point in the real-time ultrasound image; according to the time delay corresponding to the scattering signal of each pixel point, sampling each channel signal and correcting the time delay of each channel signal; according to the intensity attenuation value of the scattering signal of each pixel point between each array element, performing intensity compensation on the scattering signal of each pixel point and correcting the intensity loss.
[0109] In some embodiments, the preset calculation method is based on a straight line propagation tracking method or a reverse time migration method.
[0110] In some embodiments, the first generation module 207 is specifically used to: superimpose the signals of each channel after delay correction and intensity compensation to obtain real-time ultrasonic bone imaging; or perform coherence combination processing on the signals of each channel after delay correction and intensity compensation to obtain real-time ultrasonic bone imaging.
[0111] It is understandable that the modules described in the CT-assisted ultrasonic bone imaging device are similar to those described in the reference Figure 1 Therefore, the operations, features and beneficial effects described above for the method are also applicable to the CT-assisted ultrasonic bone imaging device and the modules contained therein, and will not be described in detail here.
[0112] See also Figure 4 Based on the inventive concept of a CT-assisted ultrasonic bone imaging method in the aforementioned embodiment, an embodiment of the present application provides an electronic device. The electronic device may include but is not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), etc., and fixed terminals such as digital TVs, desktop computers, etc. The electronic device includes a processing device 301 (such as a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a ROM 302 (read-only memory) or a program loaded from a storage device 308 to a RAM 303 (random access memory). In RAM 303, various programs and data required for the operation of the electronic device are also stored. The processing device 301, ROM 302, and RAM 303 are connected to each other via a bus 304. The input / output interface (i.e., an I / O interface 305) is also connected to the bus 304.
[0113] Typically, the following devices may be connected to the I / O interface 305: an input device 306 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 307 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 308 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 309. The communication device 309 may allow the electronic device to communicate with other devices wirelessly or by wire to exchange data.
[0114] In particular, according to some embodiments of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from the network through the communication device 309, or installed from the storage device 308, or installed from the ROM 302. When the computer program is executed by the processing device 301, the above-mentioned functions defined in the method of some embodiments of the present application are executed.
[0115] It should be noted that the computer-readable medium recorded in some embodiments of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present application, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In some embodiments of the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
[0116] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Nontransferab le), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.
[0117] The computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device. The computer-readable medium carries one or more programs, and when the one or more programs are executed by the electronic device, the method steps of any of the above technical solutions may be implemented.
[0118] The computer program code for performing the operation of some embodiments of the present application can be written in one or more programming languages or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer, partially on the remote computer, or completely on the remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., using an Internet service provider to connect through the Internet).
[0119] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0120] The modules described in some embodiments of the present application may be implemented in software or hardware, and the modules described may also be arranged in a processor.
[0121] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.
[0122] Some embodiments of the present application also provide a computer program product, including a computer program, which implements any of the above-mentioned CT-assisted ultrasonic bone imaging methods when executed by a processor.
[0123] Those skilled in the art will appreciate that in one or more of the above examples, the functions described in the present invention can be implemented using a combination of hardware and software. When software is used, the corresponding functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any media that facilitates the transmission of computer programs from one place to another. Storage media can be any available media that can be accessed by general or special-purpose computers.
[0124] Although the present invention has been described in detail above by general description and specific embodiments, it is obvious to those skilled in the art that some modifications or improvements can be made to the present invention. Therefore, these modifications or improvements made without departing from the spirit of the present invention all belong to the scope of protection claimed by the present invention.
Claims
1. A CT-assisted ultrasonic bone imaging method, characterized in that: The following steps are involved: Obtain preoperative three-dimensional CT images; Calculating tissue density data, sound velocity data and sound attenuation coefficient of each voxel point in the preoperative three-dimensional CT image based on a preset approximate linear relationship coefficient; Acquire real-time position information and real-time orientation information of the ultrasound probe in three-dimensional space; Acquire parameter data of ultrasound system and ultrasound probe; Acquire real-time ultrasound images during surgery; Performing intensity compensation and time delay correction operations on the scattered signal of each pixel point in the ultrasound image according to the parameter data of the ultrasound system and the ultrasound probe, the tissue density data, the sound velocity data, the acoustic attenuation coefficient, the real-time position information and the real-time orientation information; Real-time ultrasound bone imaging is generated based on the delay-corrected and intensity-compensated signals of each channel.
2. The CT-assisted ultrasonic bone imaging method according to claim 1, characterized in that: The step of performing intensity compensation and time delay correction operations on the scattered signal of each pixel point in the ultrasound image according to the parameter data of the ultrasound system and the ultrasound probe, the tissue density data, the sound velocity data, the acoustic attenuation coefficient, the real-time position information and the real-time orientation information comprises: Based on the parameter data of the ultrasound system and ultrasound probe, the tissue density data, the sound velocity data, the sound attenuation coefficient, the real-time position information and the real-time orientation information, the acoustic wave equation is applied to simulate the propagation of ultrasound waves in the bones, and an intensity attenuation coefficient diagram and a phase distortion diagram of the bone structure to the ultrasound waves are obtained; According to the intensity attenuation coefficient map and the phase distortion map, a preset calculation method is applied to calculate the intensity attenuation value and the phase distortion value of the scattered signal of each pixel point in the real-time ultrasonic image between each array element; According to the phase distortion value of the scattering signal of each pixel point between each array element, the time delay corresponding to the scattering signal of each pixel point in the real-time ultrasound image is calculated; According to the time delay corresponding to the scattering signal of each pixel point, the signal of each channel is sampled to correct the time delay of the signal of each channel; According to the intensity attenuation value of the scattering signal of each pixel point between each array element, the scattering signal of each pixel point is intensity compensated to correct the intensity loss.
3. The CT-assisted ultrasonic bone imaging method according to claim 1, characterized in that: The parameter data of the ultrasound system and ultrasound probe include center frequency, apodization, focus setting and array element size.
4. The CT-assisted ultrasonic bone imaging method according to claim 1, characterized in that: The method for generating real-time ultrasonic bone imaging based on the signals of each channel after delay correction and intensity compensation is: superimposing the signals of each channel after delay correction and intensity compensation to obtain real-time ultrasonic bone imaging; or coherently combining the signals of each channel after delay correction and intensity compensation to obtain real-time ultrasonic bone imaging.
5. The CT-assisted ultrasonic bone imaging method according to any one of claims 1 to 4, characterized in that: The steps of obtaining the real-time position information and real-time orientation information of the ultrasound probe in three-dimensional space include: Receiving ultrasound probe video acquired by a binocular vision system; Obtaining first calibration parameters of the binocular vision system; Based on the first calibration parameters and the ultrasound probe video, a binocular vision algorithm is applied to calculate the position information and orientation information of the ultrasound probe in three-dimensional space.
6. A CT-assisted ultrasonic bone imaging device, characterized in that: include: A first acquisition module is used to acquire a preoperative three-dimensional CT image; A first calculation module, used for calculating tissue density data, sound velocity data and sound attenuation coefficient of each voxel point in the preoperative three-dimensional CT image based on a preset approximate linear relationship coefficient; A second acquisition module is used to acquire real-time position information and real-time orientation information of the ultrasound probe in three-dimensional space; A third acquisition module is used to acquire parameter data of the ultrasound system and the ultrasound probe; A fourth acquisition module is used to acquire real-time ultrasound images during surgery; A first correction module, configured to perform intensity compensation and time delay correction operations on the scattered signal of each pixel point in the ultrasound image according to the parameter data of the ultrasound system and the ultrasound probe, the tissue density data, the sound velocity data, the acoustic attenuation coefficient, the real-time position information and the real-time orientation information; The first generating module is used to generate real-time ultrasonic bone imaging according to the signals of each channel after delay correction and intensity compensation.
7. The ultrasonic bone imaging device according to claim 6, characterized in that: The first correction module is specifically used for: Based on the parameter data of the ultrasound system and ultrasound probe, the tissue density data, the sound velocity data, the sound attenuation coefficient, the real-time position information and the real-time orientation information, the acoustic wave equation is applied to simulate the propagation of ultrasound waves in the bones, and an intensity attenuation coefficient diagram and a phase distortion diagram of the bone structure to the ultrasound waves are obtained; According to the intensity attenuation coefficient map and the phase distortion map, a preset calculation method is applied to calculate the intensity attenuation value and the phase distortion value of the scattered signal of each pixel point in the real-time ultrasonic image between each array element; According to the phase distortion value of the scattering signal of each pixel point between each array element, the time delay corresponding to the scattering signal of each pixel point in the real-time ultrasound image is calculated; According to the time delay corresponding to the scattering signal of each pixel point, the signal of each channel is sampled to correct the time delay of the signal of each channel; According to the intensity attenuation value of the scattering signal of each pixel point between each array element, the scattering signal of each pixel point is intensity compensated to correct the intensity loss.
8. An electronic device, characterized in that: include: one or more processors; a storage device having one or more programs stored thereon; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 6.
9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processing device, the method according to any one of claims 1 to 6 is implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processing device, the method according to any one of claims 1 to 6 is implemented.
