Photoacoustic imaging method, device, medium and electronic equipment
Through the ultrasonic sensor matrix arranged by Fibonacci and the precise positioning of sampling point distribution, the three-dimensional image accuracy and speed in photoacoustic imaging technology are solved, and efficient biomedical imaging is achieved.
Patent Information
- Application Number
- CN202411093910.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-09
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2044-08-09
AI Technical Summary
When building three-dimensional images, existing photoacoustic imaging technology has low accuracy and slow speed, which cannot meet the monitoring needs of high precision and high efficiency.
Using the ultrasonic sensor matrix arranged by Fibonacci, by determining the sampling point distribution and rotation angle, the pulsed laser outputs pulsed laser and collects ultrasonic data to construct a three-dimensional image.
The accuracy and construction speed of three-dimensional images are improved, and efficient biomedical imaging is achieved.
Smart Images

Figure CN118592905B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of computer technology, and in particular to a photoacoustic imaging method, device, medium and electronic device. Background Art
[0002] In recent years, with the development of computer technology, biomedical imaging technology has also made progress. Currently, photoacoustic imaging (PAI) technology is used to construct three-dimensional images of tissues for vascular network monitoring, tumor detection, oxygen saturation change monitoring, inflammatory response assessment, and drug delivery monitoring.
[0003] The existing PAI technology irradiates the target tissue with a pulsed light source, causing the blood in the target tissue to absorb light energy and convert it into heat energy, resulting in instantaneous thermoelastic expansion, thereby generating ultrasonic waves. Ultimately, the ultrasonic data is collected through a sensor array to construct a three-dimensional image.
[0004] However, during monitoring, the amount of ultrasonic data collected by a fixed sensor array is small, which results in a low precision of the constructed three-dimensional image. To construct a three-dimensional image with higher precision, multiple sets of ultrasonic data at different positions need to be collected, which results in a slow speed of constructing the three-dimensional image. Therefore, during monitoring, the precision of the constructed three-dimensional image is low, and for this reason, this specification provides a photoacoustic imaging method. Summary of the invention
[0005] The present application provides a photoacoustic imaging method to partially solve the above-mentioned problems existing in the prior art.
[0006] A photoacoustic imaging method, the method is applied to a photoacoustic imaging system, the sampling component of the photoacoustic imaging system is a Fibonacci-arranged ultrasonic sensor matrix, the method comprises:
[0007] According to the sampling point distribution that meets the expected sampling density, the sample fixing position and the initial arrangement position of each ultrasonic sensor in the sampling component, the rotation angle required by the sampling component when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution is determined; wherein the rotation angle is smaller than the angle of one rotation of the sampling component;
[0008] In response to the acquisition instruction, the pulse laser of the photoacoustic imaging system is controlled to output pulse laser to the sample at the fixed position of the sample, and the sampling component is controlled to rotate based on the rotation angle while collecting ultrasonic data at a preset frequency;
[0009] A three-dimensional image of the sample is determined based on the ultrasonic data acquired during the rotation process, and the three-dimensional image is displayed.
[0010] Optionally, the method further comprises:
[0011] According to a comparison table of preset frequencies of pulsed laser output by the pulsed laser, the preset frequency is determined from preset frequencies of the corresponding sensor array that are not greater than the frequencies of the pulsed laser output by the pulsed laser.
[0012] Optionally, according to the sampling point distribution that meets the expected sampling density, the sample fixing position and the initial arrangement position of each ultrasonic sensor in the sampling component, determining the rotation angle required by the sampling component when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution specifically includes:
[0013] Determine the origin position of the ultrasonic sensor matrix arranged according to the Fibonacci arrangement, and determine the rotation axis passing through the origin position and the sample fixing position;
[0014] Get preset step angles of different sizes;
[0015] For each preset step angle, the sampling component is rotated with the rotation axis as the center according to the preset number of steps and the step angle;
[0016] After the sampling component rotates the step angle for the step number of times, determining the arrangement position of the ultrasonic sensor after each rotation, and determining the sampling point distribution of the step angle according to the arrangement position initial arrangement position of the ultrasonic sensor and the determined arrangement positions;
[0017] From the sampling point distributions of each step angle, determine the sampling point distribution that meets the expected sampling density;
[0018] The size of the step angle for generating any sampling point distribution is determined from the sampling point distribution that meets the expected sampling density, which serves as the rotation angle that the sampling component needs to rotate around the rotation axis when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution.
[0019] Optionally, in response to the acquisition instruction, controlling the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample, and controlling the sampling component to rotate based on the rotation angle while collecting ultrasonic data at a preset frequency, specifically includes:
[0020] In response to the acquisition instruction, controlling the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample;
[0021] Controlling the sampling component to rotate based on the rotation angle, rotating multiple times, and collecting ultrasonic data at a preset frequency while rotating until a preset collection time is reached;
[0022] Determining a three-dimensional image of the sample based on each set of ultrasonic data acquired during the rotation process and displaying the three-dimensional image specifically includes:
[0023] According to the ultrasonic data collected during each rotation, a change process of the three-dimensional image of the sample is constructed in time sequence.
[0024] Optionally, in response to the acquisition instruction, controlling the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample, and controlling the sampling component to rotate based on the rotation angle while collecting ultrasonic data at a preset frequency, specifically includes:
[0025] In response to the acquisition instruction, controlling the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample;
[0026] Controlling the sampling component to rotate alternately forward and reverse based on the rotation angle, and collecting ultrasonic data at a preset frequency while rotating until a preset collection time is reached;
[0027] Determining a three-dimensional image of the sample based on each set of ultrasonic data acquired during the rotation process and displaying the three-dimensional image specifically includes:
[0028] According to the ultrasonic data respectively collected during each alternating forward rotation and reverse rotation, a change process of the three-dimensional image of the sample is constructed in time sequence.
[0029] Optionally, determining a sampling point distribution that satisfies an expected sampling density from the sampling point distributions of each step angle specifically includes:
[0030] For each sampling point distribution, the sampling point distribution is divided into a number of sub-areas according to a preset area size, and the number of sampling points contained in each sub-area is determined;
[0031] According to the number of sampling points in each sub-area, determine the uniformity of the distribution of the sampling points;
[0032] According to the uniformity of the distribution of each sampling point, a sampling point distribution that is within a preset uniformity threshold and meets the expected sampling density is determined.
[0033] Optionally, determining the rotation angle required by the sampling component when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution specifically includes:
[0034] Determining the maximum rotation angle of the sampling component;
[0035] Determine the angle of rotation of the stepping number of rotation angles within the maximum rotation angle when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution;
[0036] The sampling component needs to rotate at an angle according to the angle size and the number of rotations.
[0037] This specification provides a photoacoustic imaging device, which is applied to a photoacoustic imaging system. The sampling component of the photoacoustic imaging system is a Fibonacci ultrasonic sensor matrix, including:
[0038] The acquisition module determines, according to the sampling point distribution that meets the expected sampling density, the sample fixing position and the initial arrangement position of each ultrasonic sensor in the sampling component, the rotation angle required by the sampling component when the sampling component collects the ultrasonic data of each sampling point in the sampling point distribution; wherein the rotation angle is smaller than the angle of one rotation of the sampling component;
[0039] The acquisition module controls a preset pulse laser to output pulse laser to the sample at the fixed position of the sample in response to the acquisition instruction, controls the sampling component to rotate according to the rotation angle, and controls each ultrasonic sensor to collect ultrasonic data according to a preset frequency;
[0040] The output module determines a three-dimensional image of the sample based on each set of ultrasonic data acquired during the rotation process, and displays the three-dimensional image.
[0041] This specification provides a computer storage medium, wherein the storage medium stores a computer program, and when the computer program is executed by a processor, a photoacoustic imaging method is implemented.
[0042] The present specification provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein a photoacoustic imaging method is implemented when the processor executes the program.
[0043] The present specification provides a photoacoustic imaging method, which first determines the rotation angle required by the sampling component when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution according to the sampling point distribution that meets the expected sampling density, the sample fixing position and the initial arrangement position of each ultrasonic sensor in the sampling component, and then controls the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the sample fixing position in response to the collection instruction, and controls the sampling component to rotate based on the rotation angle while collecting ultrasonic data at a preset frequency, and finally determines a three-dimensional image of the sample according to the ultrasonic data obtained during the rotation process, and displays the three-dimensional image.
[0044] It can be seen from the above method that by collecting ultrasonic data at different positions of the sample, an accurate three-dimensional image is constructed based on the collected ultrasonic data. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] The drawings described herein are used to provide a further understanding of this specification and constitute a part of this specification. The illustrative embodiments and descriptions of this specification are used to explain this specification and do not constitute an improper limitation on this specification. In the drawings:
[0046] Figure 1 A schematic diagram of a photoacoustic imaging method provided in this specification;
[0047] Figure 2 A schematic diagram of a photoacoustic imaging system for a photoacoustic imaging method provided in this specification;
[0048] Figure 3 A comparison chart of three-dimensional image effects of a photoacoustic imaging method provided in this specification;
[0049] Figure 4 A top view of a Fibonacci-arranged ultrasonic sensor matrix for a photoacoustic imaging method provided in this specification;
[0050] Figure 5 A stereogram of a Fibonacci-arranged ultrasonic sensor matrix for a photoacoustic imaging method provided in this specification;
[0051] Figure 6 A top view of the sampling point distribution of a photoacoustic imaging method provided in this specification;
[0052] Figure 7 A stereogram of the sampling point distribution of a photoacoustic imaging method provided in this specification;
[0053] Figure 8 A top view of another sampling point distribution of a photoacoustic imaging method provided in this specification;
[0054] Fig. 9 A top view of another sampling point distribution of a photoacoustic imaging method provided in this specification;
[0055] Fig.10 A schematic diagram of a three-dimensional image constructed from ultrasonic wave data at different times in a photoacoustic imaging method provided in this specification;
[0056] Fig.11 A schematic diagram of sub-regions of sampling point distribution of a photoacoustic imaging method provided in this specification;
[0057] Fig.12A schematic diagram of a sub-region of another sampling point distribution of a photoacoustic imaging method provided in this specification;
[0058] Fig.13 A schematic diagram of a photoacoustic imaging method provided in this specification;
[0059] Fig.14 A method corresponding to the Figure 1 Schematic diagram of electronic equipment. DETAILED DESCRIPTION
[0060] In order to make the purpose, technical solutions and advantages of this specification more clear, the technical solutions of this specification will be clearly and completely described below in combination with the specific embodiments of this specification and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0061] The technical solutions provided by the embodiments of this specification are described in detail below in conjunction with the accompanying drawings.
[0062] like Figure 1 As shown, Figure 1 A schematic diagram of a photoacoustic imaging method provided in this specification, and Figure 1 The photoacoustic imaging method shown in Figure 2 The photoacoustic imaging system shown is operated Figure 2 The schematic diagram of the photoacoustic imaging system provided in this specification includes a sampling component 1 for collecting ultrasonic data. The photoacoustic imaging system also includes a rotator 2, which forms a negative feedback control of the sampling component 1 through a stepper motor and an angle encoder arranged in the rotator 2, so as to rotate the sampling component 1 according to an accurate rotation angle. The photoacoustic imaging system also includes a pulse laser, which couples the pulse laser emitted by each optical fiber 3 of the pulse laser at a fixed position of the sample by moving the 8 optical fibers 3 of the pulse laser to achieve wide-field light illumination excitation of the sample. Among them, the sampling component 1 is fixed on the rotating component of the rotator 2, and each optical fiber 3 of the pulse laser has no connection relationship with the sampling component 1.
[0063] In the sampling component 1, the distribution of each ultrasonic sensor conforms to the Fibonacci arrangement, and the coordinates of each sensor in the ultrasonic sensor array are shown in the formula:
[0064] ,
[0065] ,
[0066] ,
[0067] Where N is the total number of sensors, n is the sensor number, and the coordinates of the nth sensor are ,By arranging the sensors according to the spiral Fibonacci arrangement, uniform ,coverage of ultrasonic data collection is achieved.
[0068] like Figure 1 The photoacoustic imaging method shown specifically comprises the following steps:
[0069] S101: Determine the rotation angle required for the sampling component when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution according to the sampling point distribution that meets the expected sampling density, the sample fixing position and the initial arrangement position of each ultrasonic sensor in the sampling component; wherein the rotation angle is smaller than the angle of one rotation of the sampling component.
[0070] When the existing PAI technology is used for monitoring, in order to construct a three-dimensional image, ultrasonic waves are collected through a fixed three-dimensional sensor array, and a three-dimensional image is constructed based on the collected ultrasonic data. However, due to the spherical diffusion of ultrasonic propagation, there will always be uncollected ultrasonic waves between the ultrasonic sensors in the sensor array, so there are uncollected data areas between the sensor arrays, resulting in limited accuracy of the constructed three-dimensional image. To construct a high-precision three-dimensional image, it is usually necessary to move the linear sensor array to collect ultrasonic data at different angles, but this prolongs the time of model construction and affects efficiency.
[0071] In one or more embodiments of the present application, in order to solve the problem that the speed of building a model and the accuracy of the built model cannot be taken into account at the same time. Figure 2 In order to collect ultrasonic waves at different positions of the sample, the photoacoustic imaging system first obtains the sampling point distribution that meets the expected sampling density, the sample fixed position, and the initial arrangement position of each ultrasonic sensor in the sampling component. The photoacoustic imaging system then determines the sampling component to collect ultrasonic data based on the obtained position and distribution, and the sampling component needs to rotate less than the angle of one rotation of the sampling component.
[0072] Specifically, in one or more embodiments of the present application, in order to utilize the uniform characteristics of the Fibonacci arrangement, the photoacoustic imaging system first determines the origin position of the ultrasonic sensor matrix according to the Fibonacci arrangement, and then determines a virtual straight line passing through the origin position and the fixed position of the sample as the rotation axis of the acquisition component.
[0073] Secondly, to ensure that the position collected by the sampling component after rotating according to the step angle meets the expectation, the photoacoustic imaging system obtains the preset step angles of different sizes, and then for each preset step angle, the sampling component is rotated according to the preset number of steps and the step angle with the rotation axis as the center. After the sampling component rotates the step angle for the number of steps, the photoacoustic imaging system determines the arrangement position of the ultrasonic sensor after each rotation, and determines the sampling point distribution of the step angle based on the initial arrangement position of each ultrasonic sensor and the arrangement positions determined after rotation. The photoacoustic imaging system then determines the sampling point distribution that meets the expected sampling density from the sampling point distribution of each step angle.
[0074] Finally, in order to determine the rotation angle according to the selected sampling point distribution, the photoacoustic imaging system determines the size of the step angle for generating any sampling point distribution from the sampling point distribution that meets the expected sampling density, which is the rotation angle that the sampling component needs to rotate around the rotation axis when collecting ultrasonic data from each sampling point in the sampling point distribution.
[0075] S103: In response to the acquisition instruction, control the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample, and control the sampling component to rotate based on the rotation angle while acquiring ultrasonic data at a preset frequency.
[0076] After the rotation angle is determined, in response to the received acquisition instruction, the photoacoustic imaging system is controlled to control the pulse laser to output pulse laser to the sample at the fixed position of the sample, so that the sample emits ultrasonic waves for detection by the ultrasonic sensor. While controlling the pulse laser to send pulse laser, the sampling component is controlled to rotate multiple times based on the rotation angle, and during the rotation, ultrasonic data of different positions of the sample are collected according to the preset frequency.
[0077] Specifically, in response to the acquisition instruction, the photoacoustic imaging system controls the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample. While controlling the pulse laser to send the pulse laser, the sampling component is controlled to rotate multiple times based on the rotation angle, and during the rotation process, the ultrasonic data of the sample is collected according to the preset frequency.
[0078] It should be additionally explained here that, in order to ensure wide-field light illumination excitation for the sample, the preset frequency is the frequency at which each optical fiber on the preset laser pulser uniformly emits pulsed lasers during the movement of the sampling component.
[0079] S105: Determine a three-dimensional image of the sample according to the ultrasonic data acquired during the rotation process, and display the three-dimensional image.
[0080] After collecting ultrasonic data at different positions of the sample, a three-dimensional image of the sample is constructed to reflect the structure inside the sample, and the constructed three-dimensional image is displayed.
[0081] It should be noted that the three-dimensional image constructed in this step is to use the three-dimensional image as a carrier to display the structure in the sample. In other words, it is not necessary to generate a three-dimensional image. For example, this step can also construct a three-dimensional model based on the collected ultrasonic data, as well as other carriers containing the structural information in the sample. This manual does not limit which carrier to construct, and it can be selected as needed.
[0082] based on Figure 1 The photoacoustic imaging method shown can achieve the following: first, according to the sampling point distribution that meets the expected sampling density, the sample fixed position and the initial arrangement position of each ultrasonic sensor in the sampling component, determine the rotation angle required by the sampling component when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution, and then, in response to the collection instruction, control the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the sample fixed position, and control the sampling component to rotate based on the rotation angle while collecting ultrasonic data at a preset frequency, and finally determine the three-dimensional image of the sample according to the ultrasonic data obtained during the rotation process, and display the three-dimensional image method, collect ultrasonic data at different positions of the sample, and construct an accurate three-dimensional image based on the collected ultrasonic data.
[0083] Figure 3 This is a comparison chart of the three-dimensional image effect of a photoacoustic imaging method provided in this specification. Figure 3 (a) is not used. Figure 1 The method shown, during monitoring, constructs a three-dimensional image based on ultrasonic data collected by a fixed sensor array, Figure 3 In (a), there are a lot of noise points, the image is distorted and the features are broken, making it difficult to identify the structure in the sample. Figure 1 The three-dimensional image constructed by the method is as follows Figure 3 As shown in (b) of the figure, from the contrast and fidelity of the image, the use Figure 1 The method shown in Figure 3 The 3D image quality of (b) is significantly higher than Figure 3 (a) in the figure.
[0084] In step S101, in order to solve the problem that there may be duplication of collection points, so that the sampling component can collect ultrasonic data at different positions after rotation, this specification also provides an embodiment, according to the properties of the Fibonacci sequence and the preset initial rotation angle, the rotation angle of the sampling component is determined, and then according to the preset two initial rotation angles, the sample fixing position and the initial arrangement position of each ultrasonic sensor in the sampling component, the rotation angle required by the sampling component when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution is determined. The specific formula is as follows:
[0085]
[0086] in, is the rotation angle of the nth rotation, as well as These are two preset initial rotation angles. When the determined rotation angle is greater than the angle of one rotation of the sampling component, the angle of the rotation angle that is greater than one rotation is used again as the rotation angle.
[0087] To further demonstrate the Fibonacci arrangement, this manual also provides an implementation Figure 1 The Fibonacci arrangement of ultrasonic sensors in the photoacoustic imaging method, for example, when the total number of ultrasonic sensors in the sampling component is preset to be 256, the top view of the Fibonacci arrangement of the ultrasonic sensor matrix is as follows Figure 4 As shown, the stereogram of the ultrasonic sensor matrix arranged in Fibonacci is as follows Figure 5 As shown, in Figure 4 as well as Figure 5 In the figure, each black dot is the location of each ultrasonic sensor.
[0088] In one or more embodiments of the present specification, in order to accurately collect the ultrasonic signal of the sample, the collection surface of each ultrasonic sensor is a planar non-focusing type, the normal of the collection surface points to the center of the sphere, and each has an independent output line to transmit the acquired ultrasonic data. In order to prevent crosstalk noise caused by dense wiring, each of the above-mentioned output lines adopts a coaxial cable structure. For example, each of the above-mentioned ultrasonic sensors can select an ultrasonic sensor with a center frequency of 3.16 MHz and a diameter of 5 mm.
[0089] In the above embodiment, the acoustic coupling medium is placed between the surface of the sampling component on which each ultrasonic sensor is arranged and the sample fixing position. The sampling component is rotated by a stepper motor. In order to ensure the stability of the sampling component, the sampling component is rigidly fixed to the rotating table of the built-in stepper motor and angle encoder. For example, deionized water can be used as the acoustic coupling medium.
[0090] In one or more embodiments of the present specification, multiple pulsed lasers may be used to optimize the wide-field light illumination excitation of the sample. Through the above-mentioned pulsed lasers, the ultrasonic waves of the sample can be excited to the maximum extent. For example, by controlling multiple pulsed lasers at the same time, the pulsed lasers emitted by multiple quartz fiber bundles of each pulsed laser are coupled to achieve wide-field light illumination excitation with better lighting effect, wherein the numerical aperture of each quartz fiber bundle is 0.22, and the transmission window of each quartz fiber is a near-infrared window. Then, a signal is sent through an external system or event to control the light output, and its output end is the transmission window of the fiber bundle, which ensures that the light energy in the optical fiber is delivered to the imaging space with minimal loss. For example, a pulsed laser with a wavelength of 1064 nanometers, an energy of 100 millijoules, a laser duration of 10 nanoseconds, and an occurrence frequency of 10 Hz can be selected.
[0091] In one or more embodiments of the present specification, a data acquisition card is required to convert an ultrasonic analog signal into an ultrasonic data signal, and then transmit the converted ultrasonic data to construct a three-dimensional image. Among them, the pre-low-noise multi-channel amplifier of the data acquisition card is preset to amplify the signal amplitude of the received ultrasonic analog signal by several times. For example, 256 photoacoustic signals collected by 256 ultrasonic sensors can be transmitted to a parallel data acquisition card to convert the ultrasonic analog signal into an ultrasonic data signal, and the collected ultrasonic signal is preset to be amplified 10 times in the low-noise multi-channel amplifier.
[0092] In one or more embodiments of the present specification, the photoacoustic imaging system is driven by an integrated sequence pulse generator, which triggers the sampling component, rotator and pulse laser to work together by outputting the amplitude, delay and duty cycle of the multi-channel square wave pulse train.
[0093] The method provided in this specification also includes that before collecting ultrasonic data at a preset frequency in step S103, the photoacoustic imaging system determines a preset frequency from the preset frequencies of the sensor array corresponding to the frequencies of the pulsed laser output by the pulsed laser according to a comparison table of preset frequencies of the pulsed laser output by the pulsed laser, for use by the sampling component in step S103 to collect ultrasonic data.
[0094] This manual provides Figure 4 The top view of the sampling distribution obtained by rotating 10 times clockwise at a step angle of 1.5 degrees. In order to fully demonstrate the sampling distribution, this specification also provides a top view of the sampling point distribution of a photoacoustic imaging method, such as Figure 6 As shown, and corresponding Figure 6 A stereogram of the sampling distribution, such as Figure 7 And, corresponding to Figure 6The top view of the sampling distribution shown in FIG. 1 also provides a top view of the sampling distribution obtained by rotating 10 times clockwise at a step angle of 1.2 degrees, as shown in FIG. Figure 8 As shown in , and the top view of the sampling distribution obtained by rotating 10 times clockwise at a step angle of 1.8 degrees, as shown in Fig. 9 As shown. Figure 6 , Figure 7 , Figure 8 as well as Fig. 9 In the figure, the black dots are the sampling points of the corresponding sampling distribution.
[0095] The method provided in this specification also includes, in step S103, in order to display the structural changes in the sample monitored for a long time, in response to the acquisition instruction, the photoacoustic imaging system controls the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample. The sampling component is controlled to rotate based on the rotation angle, rotate multiple times, and collect ultrasonic data at a preset frequency while rotating until the preset acquisition time is reached.
[0096] Correspondingly, in step S105, in order to show the changes in the structure within the sample, the photoacoustic imaging system constructs a three-dimensional image of the sample in chronological order according to the ultrasonic data collected during each rotation.
[0097] This manual provides a set of pictures of three-dimensional images constructed at different times, that is, schematic diagrams of three-dimensional images constructed from ultrasound data at different times, such as Fig.10 As shown, the left side shows the images of the three-dimensional image constructed based on the ultrasonic data collected by the sampling component at the beginning of the rotation. The middle shows the image of the three-dimensional image constructed based on the ultrasonic data collected by the sampling component until one second. The right side shows the image of the three-dimensional image constructed based on the ultrasonic data collected by the sampling component until two seconds. The metabolic process of the drug particles in the sample at the beginning of the rotation, the rotation until one second, and the rotation until two seconds are respectively shown, that is, the changes in the structure in the sample to be monitored are shown.
[0098] The method provided in this specification also includes that in step S103, because the motion structure of the rotator often cannot make the sampling component rotate continuously in a single direction, it is necessary to reduce the degree to which the sampling component relies on the motion structure of the rotator. For this purpose, a method for controlling the reciprocating rotation of the sampling component is provided. In response to the acquisition instruction, the photoacoustic imaging system controls the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample. The sampling component is controlled to rotate alternately forward and reverse based on the rotation angle, and ultrasonic data is collected at a preset frequency while rotating until the preset acquisition time is reached.
[0099] Correspondingly, in step S105, in order to display the monitored changes in the structure within the sample, the photoacoustic imaging system constructs a three-dimensional image of the sample in chronological order according to the ultrasonic data collected during each alternating forward and reverse rotations.
[0100] In one or more embodiments of the present specification, the rotator continuously rotates back and forth within a small angle, causing the sampling component to rotate 10 times in each rotation direction, and at least one data acquisition is performed at each rotation angle position. And based on the 10 sets of ultrasonic data collected in each rotation direction each time, a wide-field three-dimensional image is reconstructed as the imaging result of stereo photoacoustic calculation. Among them, the total time consumed to collect ultrasonic data to construct a three-dimensional image is within 1 second. For example, the pulse laser can be preset with a frequency of 10 Hz and a repetition period of 0.1 seconds, so that the pulse laser outputs laser pulses, and at the same time, data acquisition at a sampling rate of 40 MHz is started when the laser pulse is output.
[0101] The method provided in this specification also includes, in step S103, to improve the uniformity of the sampling point distribution. The photoacoustic imaging system first divides each sampling point distribution into a number of sub-areas according to a preset area size, and determines the number of sampling points contained in each sub-area. The photoacoustic imaging system then determines the uniformity of the sampling point distribution according to the number of sampling points in each sub-area. Finally, the photoacoustic imaging system determines the sampling point distribution that is within the preset uniformity threshold and meets the expected sampling density according to the uniformity of each sampling point distribution.
[0102] Specifically, in one or more embodiments of the present specification, the photoacoustic imaging system determines the variance value of the sampling point distribution by determining the number of sampling points contained in each sub-region. Then, according to the variance value of each sampling point distribution, the sampling point distribution with the smallest variance is selected as the sampling point distribution with the highest uniformity. Figure 6 as well as Fig. 9 The sampling point distribution shown in the figure is divided into corresponding sub-areas, and we can get Fig.11 as well as Fig.12 The black rectangles in each figure illustrate a single sub-region in each figure, and then the distribution of each sampling point is divided according to each sub-region, and then according to Fig.11 Each sub-region and Fig.12 The number of sampling points in each sub-area is changed, and the comparison is Fig.11 as well as Fig.12 ,get Fig.11 The number of sampling points in each sub-area changes Fig.12 ,The variance of the number of sampling points in the sub-region is smaller and the uniformity is higher.
[0103] It is necessary to explain here that the method of calculating the variance in the above embodiment only provides a way to calculate the uniformity. This specification does not limit how to calculate the uniformity of the distribution of sampling points, which can be selected as needed.
[0104] The method provided in this specification also includes that in step S101, in order to ensure that the determined rotation angle is within the rotation angle that can be achieved by the photoacoustic imaging system, the photoacoustic imaging system first determines the maximum rotation angle of the sampling component. The photoacoustic imaging system then determines the angle size of the rotation angle of the step number when the sampling component collects the ultrasonic data of each sampling point in the sampling point distribution within the maximum rotation angle. Finally, the photoacoustic imaging system determines the required rotation angle of the sampling component based on the angle size and the number of rotations.
[0105] It should be noted that in one or more embodiments of the present specification, in order to further improve the real-time performance of constructing a three-dimensional image, multiple rotation angles may be determined and the rotation angle with the smallest angle may be selected to reduce the time required for movement during acquisition and improve the timeliness of the constructed three-dimensional image.
[0106] Similarly, to further improve the accuracy of constructing a three-dimensional image, a sampling point distribution with the highest uniformity is selected from among the sampling point distributions, and the corresponding rotation angle is used as the rotation angle used during acquisition.
[0107] Through the above two methods of determining the rotation angle, a method can be obtained to seek to balance the accuracy and real-time performance of three-dimensional images. That is, according to the preset accuracy weight and real-time weight, a rotation angle with more uniform sampling and a smaller rotation angle is determined as the rotation angle used during acquisition.
[0108] This manual also provides Figure 1 The device corresponding to the flowchart of the photoacoustic imaging method is as follows Fig.13 As shown:
[0109] The acquisition module 201 determines the rotation angle required by the sampling component when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution according to the sampling point distribution that meets the expected sampling density, the sample fixing position and the initial arrangement position of each ultrasonic sensor in the sampling component; wherein the rotation angle is smaller than the angle of one rotation of the sampling component;
[0110] The acquisition module 203 controls the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample in response to the acquisition instruction, and controls the sampling component to rotate based on the rotation angle while collecting ultrasonic data at a preset frequency;
[0111] The output module 205 determines a three-dimensional image of the sample according to the ultrasonic data acquired during the rotation process, and displays the three-dimensional image.
[0112] Optionally, the device further includes a frequency module 207, which is used to determine a preset frequency from preset frequencies of the sensor array corresponding to the frequency of the pulsed laser output according to a comparison table of preset pulsed laser output frequencies.
[0113] Optionally, the acquisition module 201 is used to determine the origin position of the ultrasonic sensor matrix arranged according to the Fibonacci arrangement, and determine the rotation axis passing through the origin position and the sample fixed position. Obtain each preset step angle of different sizes. For each preset step angle, the sampling component is rotated according to the preset number of steps and the step angle with the rotation axis as the center. After the sampling component rotates the step angle for the number of steps, the arrangement position of the ultrasonic sensor after each rotation is determined, and the sampling point distribution of the step angle is determined according to the initial arrangement position of the arrangement position of the ultrasonic sensor and the determined arrangement positions. From the sampling point distribution of each step angle, determine the sampling point distribution that meets the expected sampling density. From the sampling point distribution that meets the expected sampling density, determine the size of the step angle for generating any sampling point distribution, as the rotation angle that the sampling component needs to rotate around the rotation axis when collecting ultrasonic data of each sampling point in the sampling point distribution.
[0114] Optionally, the acquisition module 203 is used to control the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample in response to the acquisition instruction. The sampling component is controlled to rotate based on the rotation angle, rotate multiple times, and collect ultrasonic data at a preset frequency while rotating until a preset acquisition time is reached. Correspondingly, the output module 205 is used to construct the change process of the three-dimensional image of the sample in chronological order according to the ultrasonic data collected respectively at each rotation.
[0115] Optionally, the acquisition module 203 is used to respond to the acquisition instruction and control the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample. The sampling component is controlled to rotate alternately forward and reverse based on the rotation angle, and ultrasonic data is collected at a preset frequency while rotating until a preset acquisition time is reached. Correspondingly, the output module 205 is used to construct the change process of the three-dimensional image of the sample in time sequence according to the ultrasonic data collected in each alternating forward rotation and reverse rotation.
[0116] Optionally, the acquisition module 201 is used to determine the maximum rotation angle of the sampling component. When the sampling component collects ultrasonic data of each sampling point in the sampling point distribution, the angle size of the rotation angle of the rotation step number is determined within the maximum rotation angle. According to the angle size and the number of rotations, the rotation angle required by the sampling component.
[0117] The present specification also provides a computer-readable storage medium, which stores a computer program, and the computer program can be used to execute the above-mentioned photoacoustic imaging method.
[0118] This manual also provides Fig.14 The one shown corresponds to Figure 1 Schematic diagram of the electronic device for photoacoustic imaging method. Fig.14 At the hardware level, the electronic device includes a processor, an internal bus, a network interface, a memory, and a non-volatile memory, and may also include other hardware required for the business. The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it to achieve the above Figure 1 Of course, in addition to the software implementation, this specification does not exclude other implementations, such as logic devices or a combination of software and hardware, etc., that is, the execution subject of the following processing flow is not limited to each logic unit, but can also be hardware or logic devices.
[0119] In the 1990s, it was very clear whether the improvement of a technology was hardware improvement (for example, improvement of the circuit structure of diodes, transistors, switches, etc.) or software improvement (improvement of the method flow). However, with the development of technology, many improvements of the method flow today can be regarded as direct improvements of the hardware circuit structure. Designers almost always obtain the corresponding hardware circuit structure by programming the improved method flow into the hardware circuit. Therefore, it cannot be said that the improvement of a method flow cannot be implemented with hardware entity modules. For example, a programmable logic device (PLD) (such as a field programmable gate array (FPGA)) is such an integrated circuit whose logical function is determined by the user's programming of the device. Designers can "integrate" a digital system on a PLD by programming themselves, without having to ask chip manufacturers to design and make dedicated integrated circuit chips. Moreover, nowadays, instead of manually making integrated circuit chips, this kind of programming is mostly implemented by "logic compiler" software, which is similar to the software compiler used when developing and writing programs, and the original code before compilation must also be written in a specific programming language, which is called hardware description language (HDL). There is not only one kind of HDL, but many kinds, such as ABEL (Advanced Boolean Expression Language), AHDL (Altera Hardware Description Language), Confluence, CUPL (Cornell University Programming Language), HDCal, JHDL (Java Hardware Description Language), Lava, Lola, MyHDL, PALASM, RHDL (Ruby Hardware Description Language), etc. The most commonly used ones are VHDL (Very-High-Speed Integrated Circuit Hardware Description Language) and Verilog. Those skilled in the art should also know that it is only necessary to program the method flow slightly in the above-mentioned hardware description languages and program it into the integrated circuit, and then it is easy to obtain the hardware circuit that implements the logic method flow.
[0120] The controller may be implemented in any suitable manner, for example, the controller may take the form of a microprocessor or processor and a computer-readable medium storing a computer-readable program code (e.g., software or firmware) executable by the (micro)processor, a logic gate, a switch, an application-specific integrated circuit (ASIC), a programmable logic controller, and an embedded microcontroller, examples of which include but are not limited to the following microcontrollers: ARC 625D, Atmel AT91SAM, Microchip PIC18F26K20, and Silicone Labs C8051F320, and the memory controller may also be implemented as part of the control logic of the memory. It is also known to those skilled in the art that, in addition to implementing the controller in a purely computer-readable program code manner, the controller may be implemented in the form of a logic gate, a switch, an application-specific integrated circuit, a programmable logic controller, and an embedded microcontroller by logically programming the method steps. Therefore, such a controller may be considered as a hardware component, and the devices for implementing various functions included therein may also be considered as structures within the hardware component. Or even, the devices for implementing various functions may be considered as both software modules for implementing the method and structures within the hardware component.
[0121] The systems, devices, modules or units described in the above embodiments may be implemented by computer chips or entities, or by products with certain functions. A typical implementation device is a computer. Specifically, the computer may be, for example, a personal computer, a laptop computer, a cellular phone, a sensor phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.
[0122] For the convenience of description, the above device is described by dividing it into various units according to its functions. Of course, when implementing this specification, the functions of each unit can be implemented in the same or multiple software and / or hardware.
[0123] Those skilled in the art will appreciate that the embodiments of this specification may be provided as methods, systems, or computer program products. Therefore, this specification may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0124] This specification is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of this specification. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0125] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0126] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0127] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0128] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0129] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-writable media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.
[0130] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.
[0131] It should be understood by those skilled in the art that the embodiments of this specification may be provided as methods, systems or computer program products. Therefore, this specification may take the form of a complete hardware embodiment, a complete software embodiment or an embodiment combining software and hardware. Moreover, this specification may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0132] This specification may be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. This specification may also be practiced in distributed computing environments where tasks are performed by remote processing devices connected through a communication network. In a distributed computing environment, program modules may be located in local and remote computer storage media, including storage devices.
[0133] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.
[0134] The above description is only an embodiment of the present specification and is not intended to limit the present specification. For those skilled in the art, the present specification may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present specification shall be included in the scope of the claims of the present specification.
Claims
1. A photoacoustic imaging method, characterized in that: The method is applied to a photoacoustic imaging system, wherein the sampling component of the photoacoustic imaging system is a Fibonacci-arranged ultrasonic sensor matrix, and the method comprises: Determine the origin position of the ultrasonic sensor matrix arranged according to the Fibonacci arrangement, and determine the rotation axis passing through the origin position and the sample fixed position; obtain preset step angles of different sizes; for each preset step angle, rotate the sampling component according to the preset number of steps and the step angle with the rotation axis as the center; after the sampling component rotates the step number, determine the arrangement position of the ultrasonic sensor after each rotation, and determine the sampling point distribution of the step angle according to the initial arrangement position of the ultrasonic sensor and the determined arrangement positions; for each sampling point distribution, divide the sampling point distribution according to the preset area size For a plurality of sub-areas, determine the number of sampling points contained in each sub-area; determine the uniformity of the sampling point distribution according to the number of sampling points in each sub-area; determine the sampling point distribution whose uniformity is within a preset uniformity threshold and satisfies the expected sampling density according to the uniformity of the sampling point distribution; from the sampling point distribution that satisfies the expected sampling density, determine the size of the step angle for generating any sampling point distribution as the rotation angle of the sampling component around the rotation axis when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution, wherein the rotation angle is less than the angle of the sampling component rotating once; In response to the acquisition instruction, the pulse laser of the photoacoustic imaging system is controlled to output pulse laser to the sample at the fixed position of the sample, and the sampling component is controlled to rotate based on the rotation angle while collecting ultrasonic data at a preset frequency until a preset acquisition time is reached; A three-dimensional image of the sample is determined based on the ultrasonic data acquired during the rotation process, and the three-dimensional image is displayed.
2. The method according to claim 1, characterized in that The method further comprises: According to a comparison table of preset frequencies of pulsed laser output by the pulsed laser, the preset frequency is determined from preset frequencies of the corresponding sensor array that are not greater than the frequencies of the pulsed laser output by the pulsed laser.
3. The method according to claim 1, characterized in that Determining a three-dimensional image of the sample according to each set of ultrasonic data acquired during the rotation process, and displaying the three-dimensional image, specifically includes: According to the ultrasonic data collected during each rotation, a change process of the three-dimensional image of the sample is constructed in time sequence.
4. The method according to claim 1, characterized in that In response to the acquisition instruction, controlling the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample, and controlling the sampling component to rotate based on the rotation angle while collecting ultrasonic data at a preset frequency, specifically includes: In response to the acquisition instruction, controlling the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample; Controlling the sampling component to rotate forward and backward alternately based on the rotation angle, and collecting ultrasonic data at a preset frequency while rotating until a preset collection time is reached; Determining a three-dimensional image of the sample based on each set of ultrasonic data acquired during the rotation process and displaying the three-dimensional image specifically includes: According to the ultrasonic data respectively collected during each alternating forward rotation and reverse rotation, a change process of the three-dimensional image of the sample is constructed in time sequence.
5. The method according to claim 1, characterized in that Determining the rotation angle required by the sampling component when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution specifically includes: Determining the maximum rotation angle of the sampling component; Determine the angle of rotation of the stepping number of rotation angles within the maximum rotation angle when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution; The sampling component needs to rotate at a certain angle according to the angle size and the number of rotations.
6. A photoacoustic imaging device, characterized in that: The device is applied to a photoacoustic imaging system, wherein the sampling component of the photoacoustic imaging system is a Fibonacci ultrasonic sensor matrix, including: The acquisition module determines the origin position of the ultrasonic sensor matrix arranged according to the Fibonacci arrangement, and determines the rotation axis passing through the origin position and the sample fixed position; obtains preset step angles of different sizes; for each preset step angle, the sampling component is rotated according to the preset number of steps and the step angle with the rotation axis as the center; after the sampling component rotates the step number, the arrangement position of the ultrasonic sensor after each rotation is determined, and the sampling point distribution of the step angle is determined according to the initial arrangement position of the ultrasonic sensor and the determined arrangement positions; for each sampling point distribution, the sampling point is divided according to the preset area size. The sampling point distribution is divided into a plurality of sub-areas, and the number of sampling points contained in each sub-area is determined; according to the number of sampling points in each sub-area, the uniformity of the sampling point distribution is determined; according to the uniformity of the sampling point distribution, a sampling point distribution whose uniformity is within a preset uniformity threshold and meets the expected sampling density is determined; from the sampling point distribution that meets the expected sampling density, the size of the step angle for generating any sampling point distribution is determined as the rotation angle of the sampling component around the rotation axis when the sampling component collects ultrasonic data of each sampling point in the sampling point distribution, wherein the rotation angle is less than the angle of the sampling component rotating once; an acquisition module, in response to an acquisition instruction, controlling the pulse laser of the photoacoustic imaging system to output pulse laser to the sample at the fixed position of the sample, and controlling the sampling component to rotate based on the rotation angle while acquiring ultrasonic data at a preset frequency until a preset acquisition time is reached; The output module determines a three-dimensional image of the sample according to the ultrasonic data obtained during the rotation process, and displays the three-dimensional image.
7. A computer storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the method described in any one of claims 1 to 5 is implemented.
8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the program, the method described in any one of claims 1 to 5 is implemented.
Citation Information
Patent Citations
Photoacoustic signal simulation method and device based on optical pulse excitation effect of spherical particles
CN115177217A
Calibration method and device for rotary driving type multi-line laser radar three-dimensional reconstruction device
CN116125446A
Bowl-shaped photoacoustic imaging probe device compounded with 1024 single crystal ultrasonic probes
CN219439182U
Photoacoustic imaging method and device
JP2013150745A
Photoacoustic image processing device and method
JP2013172810A
