Brain function three-mode imaging device and imaging method and system based on brain function three-mode imaging device
By combining a three-modal brain function imaging device with nested fiber arrays and distributed ultrasonic transducer arrays, the problem of insufficient imaging quality in the prior art is solved, efficient brain function imaging is achieved, and spatial resolution is improved. Imaging accuracy.
Patent Information
- Application Number
- CN202411078383.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-07
- Publication Date
- 2024-11-19
AI Technical Summary
When existing brain function imaging technologies improve imaging quality, complexity and cost increase, especially the insufficient imaging quality of cerebrovascular spatial distribution.
Using a brain function three-modal imaging device, combining nested fiber arrays and distributed ultrasonic transducer arrays, the spatial resolution and imaging accuracy are improved through multi-spectral imaging and photoacoustic imaging technology, and the three-modal imaging of brain function three-modal imaging is realized. .
While maintaining low cost, the spatial resolution of brain function imaging and the three-dimensional model imaging accuracy of superficial cerebral blood vessels in the cerebral cortex are improved, and the integration and depth of imaging are enhanced.
Smart Images

Figure CN118975779A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of brain function imaging, in particular to a brain function tri-modal imaging device, an imaging method based on the brain function tri-modal imaging device, and an imaging system of the brain function tri-modal imaging device. Background Art
[0002] Functional near-infrared spectroscopy (fNIRS) is a non-invasive brain imaging technology that has developed rapidly in recent years. It is widely used in the detection of psychological and physiological activities in children, adults and other groups. It infers the activity level of specific brain regions by measuring the absorption of near-infrared light by oxyhemoglobin and deoxyhemoglobin.
[0003] At present, most brain function imaging uses only near-infrared spectral imaging technology. Although the imaging accuracy has been continuously improved by planning the arrangement of the transmitting and receiving optical fibers, such as the high-resolution brain function spectral imaging device, method and system proposed in the publication number CN118000681A as the basis for the improvement of the present invention (the design scheme of the multi-spectral imaging part of the present invention completely follows the invention), the near-infrared spectral imaging technology focuses more on the depth information of the cerebral cortex in brain function imaging, and the imaging quality of the spatial distribution of cerebral blood vessels is poor. If the quality of brain function imaging is still improved by using near-infrared spectral imaging technology, the complexity and manufacturing cost of the imaging device will be multiplied.
[0004] Photoacoustic Imaging (PAI) is a biomedical imaging technology that combines the advantages of optical imaging and ultrasound imaging. It uses the absorption of light by biological tissue to produce thermal effects, resulting in the thermoelastic expansion of the tissue, thereby generating ultrasound waves. These ultrasound waves are then detected by an ultrasound transducer, and through signal processing and image reconstruction algorithms such as delayed superposition, filtered back projection, and time inversion, photoacoustic images that reflect the internal structure and function of the tissue are formed. PAI has the characteristics of high-contrast imaging, non-destructive testing, deep penetration, functional imaging, multi-scale, and multi-dimensional imaging. It has broad application prospects in the field of biomedical imaging and is gradually moving from scientific research to clinical applications.
[0005] Using photoacoustic imaging or even ultrasound imaging to improve the imaging quality of near-infrared brain function imaging is a relatively feasible solution at present. Summary of the invention
[0006] The object of the present invention is to provide a brain function tri-modal imaging device and an imaging method and system based on the device to improve the spatial resolution of brain function imaging at a relatively low cost in response to the above-mentioned problems.
[0007] The technical solution adopted by the present invention is as follows:
[0008] A brain function trimodal imaging device comprises a nested optical fiber array and a planar array optical image sensor, wherein the nested optical fiber array comprises at least two groups of transmitting-receiving arrays, each group of transmitting-receiving arrays has the same arrangement structure, each group of transmitting-receiving arrays comprises a plurality of pairs of transmitting-receiving optical fibers arranged in an array, each pair of the transmitting-receiving optical fibers comprises a transmitting optical fiber and a receiving optical fiber; the transmitting optical fibers of each group of transmitting-receiving arrays are respectively connected to laser sources, and the laser sources of each group of transmitting-receiving arrays work asynchronously in a time sequence, or work synchronously at different wavelengths; the receiving optical fibers of each group of transmitting-receiving arrays are respectively connected to the planar array image sensor after passing through a spectrum modulator; and each group of transmitting-receiving arrays are mutually nested and arranged through the following structure: in each group of transmitting-receiving arrays, between every two adjacent transmitting optical fibers, the transmitting optical fibers of all other groups of transmitting-receiving arrays are nested;
[0009] The device also includes a distributed ultrasonic transducer array composed of a plurality of ultrasonic transducers, wherein the distributed ultrasonic transducer array is distributed in the nested optical fiber array.
[0010] Furthermore, the distributed ultrasonic transducer array is arranged in the following structure: in all transmitting-receiving arrays, only one ultrasonic transducer is arranged between all transmitting and receiving optical fibers located at the same position in the transmitting-receiving array.
[0011] Furthermore, the ultrasonic transducers of the distributed ultrasonic transducer array are arranged non-uniformly.
[0012] Furthermore, the transmitting and receiving optical fibers where each ultrasonic transducer is located belong to different transmitting and receiving arrays.
[0013] Furthermore, each ultrasonic transducer corresponding to the receiving and transmitting optical fibers in the same row and / or column of the nested optical fiber array is arranged in a straight line.
[0014] Furthermore, each pair of transmitting and receiving optical fibers of each group of transmitting-receiving arrays is evenly arranged, each transmitting optical fiber of each group of transmitting-receiving arrays is evenly arranged, and each receiving optical fiber of each group of transmitting-receiving arrays is evenly arranged.
[0015] The present invention also provides an imaging method based on the above-mentioned brain function tri-modal imaging device, which comprises:
[0016] S1. Turn on the laser sources of each group of transmitting-receiving arrays in a continuous wave form according to the set timing, and each laser source is emitted through the transmitting optical fiber respectively. The scattered signal after the laser acts on the brain is received by each receiving optical fiber, and is modulated by the spectrum modulator and coupled to the area array image sensor; the light intensity of each receiving optical fiber at multiple moments is continuously detected by the area array image sensor, and the oxygenated hemoglobin concentration and the deoxygenated hemoglobin concentration at different depths are calculated according to the detected light intensity;
[0017] S2. Turn on all laser sources in the form of pulse waves according to the set timing, and the wavelengths of the laser sources are different at different times; each laser source is emitted through the transmitting optical fiber, and the distributed ultrasonic transducer array is used to receive the photoacoustic signal after the pulse laser acts on the brain; the photoacoustic signal is collected by a data acquisition card and transmitted to a computer to reconstruct the photoacoustic image;
[0018] S3, stimulating the distributed ultrasonic transducer array to emit ultrasonic signals, and receiving ultrasonic echo signals returned after acting on the brain; using a data acquisition card to collect the ultrasonic echo signals and transmit them to a computer to reconstruct an ultrasonic image.
[0019] Furthermore, step S1, step S2 and step S3 are performed sequentially.
[0020] Furthermore, the method also includes:
[0021] S4, fusing the oxygenated hemoglobin concentrations and deoxygenated hemoglobin concentrations at different depths obtained in step S1, the photoacoustic image obtained in step S2, and the ultrasound image obtained in step S3 in pairs or in threes.
[0022] The present invention also provides an imaging system based on the above-mentioned brain function tri-modal imaging device, which includes a laser source control module connected to each laser source, an ultrasound control module connected to the distributed ultrasound transducer array, a data acquisition card connected to the distributed ultrasound transducer array, and a computer connected to the area array image sensor and the data acquisition card respectively; wherein:
[0023] The laser source control module is configured to: in a multi-spectral imaging mode, turn on the laser sources of each group of transmitting-receiving arrays in a continuous wave form according to a set timing; and in a photoacoustic imaging mode, turn on all laser sources in a pulse wave form according to a set timing, and the wavelengths of the laser sources are different at different times; so that each laser source is emitted through the transmitting optical fiber respectively, and in the multi-spectral imaging mode, the scattered signals after the laser acts on the brain are received by each receiving optical fiber, and are modulated by the spectrum modulator and coupled to the area array image sensor;
[0024] The ultrasound control module is configured to: in the photoacoustic imaging mode, control the distributed ultrasound transducer array to receive the photoacoustic signal after the pulsed laser acts on the brain; and in the ultrasound imaging mode, control the distributed ultrasound transducer array to transmit the ultrasound signal and receive the ultrasound echo signal returned after the pulsed laser acts on the brain;
[0025] The data acquisition card is configured to: collect the photoacoustic signal or ultrasonic echo signal received by the distributed ultrasonic transducer array, and transmit it to the computer;
[0026] The computer is configured to: in a multi-spectral imaging mode, use the light intensity of each receiving optical fiber at multiple moments continuously detected by the area array image sensor, and calculate the oxygenated hemoglobin concentration and the deoxygenated hemoglobin concentration at different depths according to the detected light intensity; in a photoacoustic imaging mode and an ultrasonic imaging mode, reconstruct a photoacoustic image or an ultrasonic image according to the photoacoustic signal or ultrasonic echo signal collected by the data acquisition card.
[0027] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are:
[0028] The present invention nests a distributed ultrasonic transducer array in a nested optical fiber array, thereby improving the integration of the imaging device without changing the original nested optical fiber array layout and the spatial resolution of multi-spectral imaging. The laser source of the multi-spectral imaging part is used for photoacoustic imaging, which saves the cost of photoacoustic imaging and does not need to consider the layout of the laser source for photoacoustic imaging. The distributed ultrasonic transducer array itself is combined for ultrasonic imaging to achieve trimodal imaging of brain function. While ensuring that the depth of brain function imaging is sufficient, the three-dimensional model imaging accuracy of superficial cerebral blood vessels in the cerebral cortex is further improved through a highly integrated distributed ultrasonic transducer array. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] The present invention will now be described by way of example with reference to the accompanying drawings, in which:
[0030] Figure 1 It is a diagram showing the arrangement of a nested optical fiber array and a distributed ultrasonic transducer array in a tri-modal brain function imaging device in one embodiment.
[0031] Figure 2 FIG. 4 is a flow chart of a method for tri-modality imaging of brain function in one embodiment.
[0032] Figure 3 This is an embodiment of a spectrum curve of a receiving optical fiber point at time t0-t10.
[0033] Figure 4 It is the spectral absorption coefficient curve of oxygenated hemoglobin and deoxygenated hemoglobin. DETAILED DESCRIPTION
[0034] All features disclosed in this specification, or steps in all methods or processes disclosed, except mutually exclusive features and / or steps, can be combined in any manner.
[0035] Any feature disclosed in this specification (including any additional claims and abstract), unless otherwise stated, may be replaced by other equivalent or alternative features having similar purposes. That is, unless otherwise stated, each feature is only an example of a series of equivalent or similar features.
[0036] Example 1
[0037] The brain function tri-modal imaging device includes a nested optical fiber array, a planar array optical image sensor and a distributed ultrasonic transducer array.
[0038] The nested optical fiber array includes at least two groups of transmitting-receiving arrays, each group of transmitting-receiving arrays has the same arrangement structure, and each group of transmitting-receiving arrays is mutually nested. The so-called mutually nested arrangement means that in each group of transmitting-receiving arrays, between every two adjacent transmitting optical fibers, there are all other groups of transmitting-receiving arrays The transmitting optical fibers are nested; because each group of transmitting-receiving arrays has the same structure, on this basis, in each group of transmitting-receiving arrays, between every two adjacent receiving optical fibers, there are all other groups of transmitting-receiving arrays Receiving optical fibers are nested.
[0039] Each group of transmitting-receiving arrays includes multiple pairs of transmitting-receiving optical fibers arranged in an array, and each pair of the transmitting-receiving optical fibers includes a transmitting optical fiber and a receiving optical fiber. In some preferred embodiments, each pair of transmitting-receiving optical fibers of each group of transmitting-receiving arrays is evenly arranged, each transmitting optical fiber of each group of transmitting-receiving arrays is evenly arranged, and each receiving optical fiber of each group of transmitting-receiving arrays is evenly arranged. Each transmitting optical fiber is connected to a laser source, and the laser sources of each group of transmitting-receiving arrays work asynchronously in a time sequence, or work synchronously at different wavelengths. The receiving optical fibers of each group of transmitting-receiving arrays are respectively connected to the area array image sensor after passing through a spectral modulator to transmit the captured scattered signals to the area array image sensor for collection. Specifically, if Figure 1 As shown in the figure, taking two groups of transmitting-receiving arrays as an example, the hollow triangle represents the transmitting optical fiber of the first group of transmitting-receiving arrays, corresponding to the transmitting point, and the hollow circle represents the receiving optical fiber of the first group of arrays, corresponding to the receiving point. On this basis, a group of transmitting-receiving arrays with the same structure is nested, such as Figure 1 The solid triangle in the middle represents the transmitting optical fiber of the second transmitting-receiving array, and the solid circle represents the receiving optical fiber of the second array. In array form, it is:
[0040] Assume that the nested optical fiber array is unfolded and arranged as a matrix A (M×N),
[0041] Where M = 2m + 1, N = 2n, if A 2m-1,2n-1 is the first group of array laser source emission points (i.e., the laser source at Time1), then A 2m-1,2n is the second group of array laser source emission points (i.e., the laser source at Time2), then A 2m,2n-1 A is the second set of array receiving points (i.e., the detector at Time 2), 2m,2n For the first group of array receiving points (i.e., as the detector at Time1). Between adjacent laser source emission points, between laser source emission points and receiving points, and between receiving points, the Euclidean distance of 2.121 cm is satisfied. At the same time (such as Time1 or Time2), the Euclidean distance between adjacent laser source emission points and receiving points is 3 cm. More groups of emission-receiving arrays can be nested and arranged using a similar structure. The device of this embodiment increases the arrangement density (improves spatial resolution) and the number of detectors remains unchanged (a SCMOS detector, and a receiving optical fiber is connected to the SCMOS to increase the detection points). A receiving optical fiber can detect the scattered signal returned by the laser source of multiple transmitting optical fibers acting on the cerebral cortex, which corresponds to a series of transmitting optical fibers around. Since the distance between these transmitting optical fibers and the receiving optical fibers is different, the depth of detection is different, so that images of multiple depths can be obtained.
[0042] Similar to the literature cited in the background technology section, the transmitting optical fibers of each group of transmitting-receiving arrays are respectively connected to laser sources, and the laser sources of each group of transmitting-receiving arrays work asynchronously in a time sequence, or work synchronously at different wavelengths; the receiving optical fibers of each group of transmitting-receiving arrays are respectively connected to the area array image sensor after passing through a spectral modulator.
[0043] On this basis, a distributed ultrasonic transducer array composed of multiple ultrasonic transducers is nested in the nested optical fiber array to directly use the laser source of each transmitting-receiving array for photoacoustic imaging, and use the echo of the ultrasonic signal emitted by itself for ultrasonic imaging.
[0044] In some embodiments, the distributed ultrasonic transducer array is arranged by the following structure: in all transmitting-receiving arrays, only one ultrasonic transducer is arranged between all the transmitting-receiving optical fibers located at the same position in the transmitting-receiving array. The so-called transmitting-receiving optical fibers at the same position refer to the transmitting-receiving optical fibers at the same row and column positions in the transmitting-receiving array. For example, the transmitting-receiving optical fibers in the first row and the first column of the first group of transmitting-receiving arrays are at the same position as the transmitting-receiving optical fibers in the first row and the first column of other groups of transmitting-receiving arrays. Similarly, the transmitting-receiving optical fibers in the first row and the second column of all groups of transmitting-receiving arrays are at the same position... In the same position, only one ultrasonic transducer is arranged between the transmitting-receiving optical fibers in the first row and the first column of all groups of transmitting-receiving arrays, and only one ultrasonic transducer is arranged between the transmitting-receiving optical fibers in the first row and the second column of all groups of transmitting-receiving arrays... As Figure 1 In the nested optical fiber array composed of the two groups of transmitting-receiving arrays shown, all ultrasonic transducers are arranged between each pair of transmitting-receiving optical fibers of the second group of transmitting-receiving arrays, and ultrasonic transducers are no longer arranged between each pair of transmitting-receiving optical fibers of the first group of transmitting-receiving arrays. However, during photoacoustic imaging, in the transmitting-receiving optical fibers at the same position of the two groups of transmitting-receiving arrays, the ultrasonic wave generated by the laser emitted by the transmitting optical fiber can still be received by the same ultrasonic transducer arranged at the position.
[0045] certainly, Figure 1 The layout of the distributed ultrasonic transducer array in the illustrated embodiment is only for the convenience of describing how it is nested. In fact, due to the irregularity of the shape of the brain, in order to better fit the shape of the brain, the layout of each ultrasonic transducer in the distributed ultrasonic transducer array is often arranged non-uniformly. For example, the transmitting-receiving arrays to which the transmitting and receiving optical fibers of each ultrasonic transducer belong are not all the same or all different. Of course, due to the large number of ultrasonic transducers, the latter possibility is small, such as in Figure 1 In the embodiment, not all ultrasonic transducers are arranged between the retractable optical fibers of the second group of transmitting-receiving arrays, and some ultrasonic transducers are arranged between the first group of transmitting-receiving optical fibers. In addition, the ultrasonic transducers can also be arranged in a straight line in the same row (referring to the latitude direction) and / or the same column (referring to the longitude direction) to Figure 1 For reference, the ultrasonic transducers in the same row and column are arranged in a straight line. However, in this linear arrangement embodiment, it is necessary to select different transmitting-receiving arrays for the transmitting and receiving optical fibers where the ultrasonic transducers are located. For example, the ultrasonic transducers in the first column / first row are all arranged between the transmitting and receiving optical fibers of the second group of transmitting-receiving arrays, and the ultrasonic transducers in the second column / second row are all arranged between the transmitting and receiving optical fibers of the first group of transmitting-receiving arrays. If there are more groups of transmitting-receiving arrays, there are more options for arrangement.
[0046] The above-mentioned laser source can emit laser light in the form of continuous wave and pulse wave. In the multi-spectral imaging mode, i.e., the mode in which the scattered signal is captured by the receiving optical fiber, the laser light is emitted in the form of continuous wave according to the set timing, and in the photoacoustic imaging mode, i.e., the mode in which the photoacoustic signal is captured by the distributed ultrasonic transducer array, the laser light is emitted in the form of pulse wave according to the set timing.
[0047] In actual use, each probe of the device (transmitting optical fiber, receiving optical fiber, ultrasonic transducer) is usually sealed with a thin film of ultrasonic coupling liquid at the end, which is very transparent to light and sound and can be in good contact with the skin. The speed of sound of the configured coupling liquid is the same as that of soft tissue (1547m / s). The coupling liquid is transparent to the wavelength of the pulsed laser and has less attenuation to ultrasound and laser.
[0048] Example 2
[0049] This embodiment proposes a brain function tri-modal imaging method based on the brain function tri-modal imaging device of Embodiment 1. Figure 2 As shown, the method comprises the following steps:
[0050] S1. Turn on the laser sources of each group of transmitting-receiving arrays in a continuous wave form according to the set timing. Each laser source is emitted through a transmitting optical fiber respectively. Each receiving optical fiber receives the scattered signal after the laser acts on the brain, which is modulated by a spectrum modulator and coupled to the area array image sensor. The light intensity of each receiving optical fiber at multiple moments is continuously detected by the area array image sensor, and the oxygenated hemoglobin concentration and the deoxygenated hemoglobin concentration at different depths are calculated according to the detected light intensity.
[0051] The specific implementation process of step S1 includes the following sub-steps:
[0052] S11, turn on each laser source, here the laser sources of each group of transmitting-receiving arrays are turned on asynchronously, or the laser sources of each group of transmitting-receiving arrays are turned on synchronously at different frequencies. Each laser source is emitted through the transmitting optical fiber respectively, and each receiving optical fiber receives the scattered signal when the laser source of the same group of transmitting optical fibers is turned on, and is coupled to the area array image sensor after modulation by the spectrum modulator. In this step, if each group of transmitting-receiving arrays is operated in sequence, the transmitting optical fiber laser sources of each group of transmitting-receiving arrays are turned on sequentially and cyclically. For example, for N groups of transmitting-receiving arrays, the laser source of the first group of transmitting-receiving arrays is turned on first, followed by the second group, the third group... the Nth group, and then the first group, and so on. If the groups of transmitting-receiving arrays are operated synchronously by modulating the laser source frequency, all transmitting optical fiber laser sources can be turned on at the same time.
[0053] S12, using an area array image sensor to continuously detect the light intensity of each receiving optical fiber at different wavelengths of the laser source of the same group of transmitting optical fibers at multiple moments.
[0054] In this step, the area array image sensor collects the scattered spectrum to obtain the light intensity, and detects the light intensity to obtain the light intensity. Indicates that, where t i represents the i-th moment, λ j represents the jth wavelength.
[0055]
[0056] In the formula, is the emission intensity, that is, the laser source at t i The wavelength λ emitted at the moment j The light intensity of the light. The attenuation formula after absorption by oxygenated hemoglobin and deoxygenated hemoglobin is: is the wavelength of oxygenated hemoglobin j The spectral absorption coefficient of light, is the wavelength of deoxyhemoglobin j The spectral absorption coefficient of light, is oxygenated hemoglobin at t i The concentration of time, is deoxyhemoglobin at t i The concentration at the time, l is the optical path, that is, the Euclidean distance from the receiving fiber to the transmitting fiber. The absorption and scattering attenuation coefficients of the incident light by biological tissues and detection systems other than oxygenated hemoglobin and deoxygenated hemoglobin on the light propagation path are In the present invention, it is referred to as the influencing factor on the detection light intensity other than oxygenated hemoglobin and deoxygenated hemoglobin.
[0057] S13. For each receiving optical fiber, the changes in the optical path concentration of oxygenated hemoglobin and the optical path concentration of deoxygenated hemoglobin at each moment are calculated using the light intensity detected at two adjacent moments.
[0058] This step converts the differential relationship of the light intensity of different wavelengths detected at each two adjacent moments into the differential relationship of the optical path concentration of oxygenated hemoglobin and the optical path concentration of deoxygenated hemoglobin at the corresponding wavelength at each two adjacent moments, and fits the changes of the optical path concentration of oxygenated hemoglobin and the optical path concentration of deoxygenated hemoglobin at each moment according to the spectral absorption coefficients of oxygenated hemoglobin and deoxygenated hemoglobin for the corresponding wavelengths obtained from the table. In addition, before converting the differential relationship of the light intensity of different wavelengths detected at each two adjacent moments into the differential relationship of the optical path concentration of oxygenated hemoglobin and the optical path concentration of deoxygenated hemoglobin at the corresponding wavelength at each two adjacent moments, it is preferred to first eliminate the factors affecting the detected light intensity other than oxygenated hemoglobin and deoxygenated hemoglobin, that is, eliminate
[0059] Specifically, there are:
[0060] S131: To t i The light intensity measured by the detector at the moment With incident light intensity The logarithm of the ratio is as follows:
[0061]
[0062] t i+1 The light intensity measured by the detector at the moment With incident light intensity The logarithm of the ratio is as follows:
[0063]
[0064] Subtract the logarithms of the two moments to obtain the blood oxygen signal at any time and any wavelength, as shown in the following formula:
[0065] S132: Calculation of variables for oxygenated hemoglobin concentration, deoxygenated hemoglobin concentration, and light propagation path.
[0066] The time interval between two consecutive samplings of the detector is Δt = t i+1 -t i , the laser source remains stable within the Δt interval, that is,
[0067] but,
[0068] set up C i , D i t i The change in the optical path concentration of oxygenated hemoglobin and deoxygenated hemoglobin at the moment. Then:
[0069]
[0070] Due to the absorption and scattering attenuation coefficient of the incident light by the detection system on the light propagation path At the two detection moments, it can be considered unchanged, Aij = 0, Sij = 0. That is, the factors affecting the detection light intensity other than oxygenated hemoglobin and deoxygenated hemoglobin are eliminated.
[0071] Then C i , D i The overdetermined system of equations with unknown variables is:
[0072]
[0073] That is, the differential relationship between the light intensities of different wavelengths detected at two adjacent moments is converted into the differential relationship between the optical pathlength concentrations of oxygenated hemoglobin and deoxygenated hemoglobin at the corresponding wavelengths at two adjacent moments.
[0074] For example, the system of equations at time t0 is expressed as a matrix:
[0075]
[0076] S133: Fitting the changes in the optical pathlength concentration of oxygenated hemoglobin and the optical pathlength concentration of deoxygenated hemoglobin at each time.
[0077] like Figure 3 Shown is t0-t 10 The spectrum curve detected by a receiving optical fiber point at a certain moment, with the horizontal axis being wavelength, ranging from 650nm-950nm, and the vertical axis being light intensity.
[0078] Figure 4 The University of London and Hitachi Ltd. of Japan published The horizontal axis of the spectrum curve is the wavelength. From this, we can find out the spectral absorption coefficients of oxygenated hemoglobin and deoxygenated hemoglobin at the corresponding wavelength by looking up the table.
[0079] Will Transformed into That is, we get a linear equation in the form of y=ax+b, and for the I under the multiple wavelengths detected, ij , we can get multiple groups of C i and D i , use the least squares method (such as the linest function) to perform the best straight line fit and return the unknown number C i and D i That is, according to the spectral absorption coefficients of oxygenated hemoglobin and deoxygenated hemoglobin for the corresponding wavelengths obtained from the table, the changes in the optical path concentration of oxygenated hemoglobin and the optical path concentration of deoxygenated hemoglobin at each moment are fitted.
[0080] Taking the spectral resolution of 3nm as an example, The value of and the spectral intensity I of a certain point at time t0 0j As shown in Table 1.
[0081] Table 1
[0082]
[0083] The least squares calculation result is:
[0084] C0=-0.07961206, D0=0.01605797. Using the same calculation method, t0-t 10 Moment C iand D i The values are shown in Table 2.
[0085] Table 2
[0086]
[0087]
[0088] Using the same method, we get i C i , D i .
[0089] S14. The oxyhemoglobin optical path concentration and the deoxyhemoglobin optical path concentration at each receiving optical fiber point are obtained by accumulating the changes in the oxyhemoglobin optical path concentration and the deoxyhemoglobin optical path concentration at each moment over time.
[0090] Sub-step S13 obtains the changes in the optical path concentration of oxygenated hemoglobin and the optical path concentration of deoxygenated hemoglobin at each time, that is, at each time t i C i , D i . Accumulate the changes That is to t k The optical path concentration of oxygenated hemoglobin and the optical path concentration of deoxyhemoglobin at the moment.
[0091] S15. According to the different optical paths of the receiving optical fiber and the corresponding transmitting optical fiber, the concentration of oxygenated hemoglobin and the concentration of deoxygenated hemoglobin at different depths are obtained.
[0092] By definition, Since different optical paths detect different depths, after determining the optical path length l between the receiving optical fiber and the transmitting optical fiber, the oxyhemoglobin optical path length concentration and the deoxyhemoglobin optical path length concentration are divided by the corresponding optical path length l to obtain the oxyhemoglobin concentration and deoxyhemoglobin concentration at the corresponding depth.
[0093] The same method is used to calculate each receiving optical fiber point to obtain the oxygenated hemoglobin optical path concentration and deoxyhemoglobin concentration at each point. The calculation of each point can be parallelized, and the spatial distribution of blood oxygen in the brain area corresponding to each point forms a brain area blood oxygen map. The blood oxygen map at each moment can reflect the changes in the distribution state of blood oxygen concentration in the brain area.
[0094] S2. Turn on all laser sources in the form of pulse waves according to the set timing, and the wavelength of the laser source is different at different times; each laser source is emitted through the transmitting optical fiber, and the distributed ultrasonic transducer array is used to receive the photoacoustic signal after the pulse laser acts on the brain; the photoacoustic signal is collected by the data acquisition card and transmitted to the computer to reconstruct the photoacoustic image. The distributed ultrasonic transducer array receives the photoacoustic signal through phased focusing, and the time delay compensation of different ultrasonic transducers is performed through the phased delay circuit to synthesize each delayed signal. The distributed ultrasonic transducer array is actually equivalent to a detector with strong spatial directivity. In its phased focusing direction, the signals received by each ultrasonic transducer are compensated for the same phase, and the synthesized signal is the largest; in the non-phased focusing direction of the detector, the signal phase compensation of each ultrasonic transducer is different, and the signals cancel each other. During imaging, the signal collected by each ultrasonic transducer in the array element is converted into a one-dimensional image, and multiple one-dimensional images are combined into a two-dimensional image in sequence, so that photoacoustic tomography can be realized conveniently and quickly.
[0095] S3, stimulating the distributed ultrasonic transducer array to emit ultrasonic signals, and receiving ultrasonic echo signals returned after acting on the brain; using a data acquisition card to collect the ultrasonic echo signals and transmit them to a computer to reconstruct an ultrasonic image.
[0096] The photoacoustic signals and ultrasonic echo signals received by the distributed ultrasonic transducer array can be processed such as signal amplification and filtering before being collected by the data acquisition card to improve the imaging accuracy. The computer can directly use existing algorithms to reconstruct images based on photoacoustic signals or ultrasonic echo signals. For example, photoacoustic image reconstruction can reconstruct the spatial distribution of superficial blood vessels in the cerebral cortex based on algorithms such as delayed superposition, filtered back projection and time inversion, and solve blood oxygen information through multi-wavelength difference. Since both are based on ultrasonic image reconstruction, ultrasonic image reconstruction can also directly obtain structural images such as superficial blood vessels in the cerebral cortex through algorithms such as delayed superposition, filtered back projection and time inversion.
[0097] The above three steps can be performed sequentially or in other orders. After the above three steps are performed, the method can also include step S4: fusing the oxygenated hemoglobin concentration and deoxygenated hemoglobin concentration at different depths obtained in step S1, the photoacoustic image obtained in step S2, and the ultrasound image obtained in step S3 in pairs or in threes to obtain a multimodal image, which simultaneously displays multi-level blood oxygen information and a high-precision spatial model.
[0098] Example 3
[0099] This embodiment corresponds to Embodiment 2, and proposes a brain function tri-modal imaging system based on the brain function tri-modal imaging device designed in Embodiment 1.
[0100] The system includes a laser source control module connected to each laser source, an ultrasonic control module connected to a distributed ultrasonic transducer array, a data acquisition card connected to the distributed ultrasonic transducer array, and a computer connected to the array image sensor and the data acquisition card respectively; wherein:
[0101] The laser source control module is configured as follows: in the multi-spectral imaging mode, the laser sources of each group of the transmitting-receiving array are turned on in the form of continuous waves according to the set timing, so that the laser sources emit lasers in the form of continuous waves. Also, in the photoacoustic imaging mode, all laser sources are turned on in the form of pulse waves according to the set timing, and the wavelengths of the laser sources are different at different times, for example, a laser with a wavelength of 680nm is emitted at the previous moment, and a laser with a wavelength of 830nm is emitted at the next moment. Each laser source is emitted through the transmitting optical fiber respectively, and in the multi-spectral imaging mode, the scattered signals after the laser acts on the brain are received by each receiving optical fiber, and are modulated by the spectrum modulator and coupled to the area array image sensor.
[0102] The ultrasound control module is configured to: in the photoacoustic imaging mode, control the distributed ultrasound transducer array to receive the photoacoustic signal after the pulsed laser acts on the brain; and, in the ultrasound imaging mode, control the distributed ultrasound transducer array to transmit the ultrasound signal and receive the ultrasound echo signal returned after the pulsed laser acts on the brain.
[0103] The data acquisition card is configured to collect the photoacoustic signal or ultrasonic echo signal received by the distributed ultrasonic transducer array and transmit it to the computer.
[0104] The computer is configured to: in the multi-spectral imaging mode, use the light intensity of each receiving optical fiber at multiple moments continuously detected by the area array image sensor, and calculate the oxygenated hemoglobin concentration and the deoxygenated hemoglobin concentration at different depths according to the detected light intensity. In the photoacoustic imaging mode and the ultrasonic imaging mode, a photoacoustic image or an ultrasonic image is reconstructed according to the photoacoustic signal or ultrasonic echo signal collected by the data acquisition card. The specific method for calculating the oxygenated hemoglobin concentration and the deoxygenated hemoglobin concentration by the computer, and the specific method for reconstructing the photoacoustic image or the ultrasonic image according to the photoacoustic signal or the ultrasonic echo signal, can be found in Example 2, which will not be described in detail here.
[0105] The present invention is not limited to the above-mentioned specific embodiments, but extends to any new features or any new combination disclosed in this specification, as well as any new method or process steps or any new combination disclosed.
Claims
1. A brain function trimodal imaging device, comprising a nested optical fiber array and a planar array optical image sensor, wherein the nested optical fiber array comprises at least two groups of transmitting-receiving arrays, each group of transmitting-receiving arrays has the same arrangement structure, each group of transmitting-receiving arrays comprises a plurality of pairs of transmitting-receiving optical fibers arranged in an array, each pair of the transmitting-receiving optical fibers comprises a transmitting optical fiber and a receiving optical fiber; The transmitting optical fibers of each group of transmitting-receiving arrays are respectively connected to laser sources, and the laser sources of each group of transmitting-receiving arrays work asynchronously in a time sequence, or work synchronously at different wavelengths; the receiving optical fibers of each group of transmitting-receiving arrays are respectively connected to the area array image sensor after passing through a spectrum modulator; Each group of transmitting-receiving arrays is mutually nested and arranged in the following structure: in each group of transmitting-receiving arrays, between every two adjacent transmitting optical fibers, there are transmitting optical fibers of all other groups of transmitting-receiving arrays nested; It is characterized in that it also includes a distributed ultrasonic transducer array composed of a plurality of ultrasonic transducers, and the distributed ultrasonic transducer array is distributed in the nested optical fiber array.
2. The brain function tri-modal imaging device according to claim 1, characterized in that: The distributed ultrasonic transducer array is arranged in the following structure: in all transmitting-receiving arrays, only one ultrasonic transducer is arranged between all transmitting and receiving optical fibers located at the same position in the transmitting-receiving array.
3. The brain function tri-modal imaging device according to claim 2, characterized in that: The ultrasonic transducers of the distributed ultrasonic transducer array are arranged non-uniformly.
4. The brain function tri-modal imaging device according to claim 3, characterized in that: The transmitting and receiving optical fibers where each ultrasonic transducer is located belong to different transmitting and receiving arrays.
5. The brain function tri-modal imaging device according to claim 3, characterized in that: In the nested optical fiber array, each ultrasonic transducer corresponding to the transmitting and receiving optical fibers in the same row and / or column is arranged in a straight line.
6. The brain function tri-modal imaging device according to claim 2, characterized in that: Each pair of transmitting and receiving optical fibers of each group of transmitting-receiving arrays is evenly arranged, each transmitting optical fiber of each group of transmitting-receiving arrays is evenly arranged, and each receiving optical fiber of each group of transmitting-receiving arrays is evenly arranged.
7. An imaging method based on the brain function tri-modal imaging device according to any one of claims 1 to 6, characterized in that: include: S1. Turn on the laser sources of each group of transmitting-receiving arrays in a continuous wave form according to the set timing, and each laser source is emitted through the transmitting optical fiber respectively. The scattered signal after the laser acts on the brain is received by each receiving optical fiber, and is modulated by the spectrum modulator and coupled to the area array image sensor; the light intensity of each receiving optical fiber at multiple moments is continuously detected by the area array image sensor, and the oxygenated hemoglobin concentration and the deoxygenated hemoglobin concentration at different depths are calculated according to the detected light intensity; S2. Turn on all laser sources in the form of pulse waves according to the set timing, and the wavelengths of the laser sources are different at different times; each laser source is emitted through the transmitting optical fiber, and the distributed ultrasonic transducer array is used to receive the photoacoustic signal after the pulse laser acts on the brain; the photoacoustic signal is collected by a data acquisition card and transmitted to a computer to reconstruct the photoacoustic image; S3, stimulating the distributed ultrasonic transducer array to emit ultrasonic signals, and receiving ultrasonic echo signals returned after acting on the brain; using a data acquisition card to collect the ultrasonic echo signals and transmit them to a computer to reconstruct an ultrasonic image.
8. The imaging method according to claim 7, characterized in that: The steps S1, S2 and S3 are performed sequentially.
9. The imaging method according to claim 7 or 8, characterized in that: Also includes: S4, fusing the oxygenated hemoglobin concentrations and deoxygenated hemoglobin concentrations at different depths obtained in step S1, the photoacoustic image obtained in step S2, and the ultrasound image obtained in step S3 in pairs or in threes.
10. An imaging system based on the brain function tri-modal imaging device according to any one of claims 1 to 6, characterized in that: It includes a laser source control module connected to each laser source, an ultrasonic control module connected to the distributed ultrasonic transducer array, a data acquisition card connected to the distributed ultrasonic transducer array, and a computer connected to the area array image sensor and the data acquisition card respectively; wherein: The laser source control module is configured to: in a multi-spectral imaging mode, turn on the laser sources of each group of transmitting-receiving arrays in a continuous wave form according to a set timing; and in a photoacoustic imaging mode, turn on all laser sources in a pulse wave form according to a set timing, and the wavelengths of the laser sources are different at different times; so that each laser source is emitted through the transmitting optical fiber respectively, and in the multi-spectral imaging mode, the scattered signals after the laser acts on the brain are received by each receiving optical fiber, and are modulated by the spectrum modulator and coupled to the area array image sensor; The ultrasound control module is configured to: in the photoacoustic imaging mode, control the distributed ultrasound transducer array to receive the photoacoustic signal after the pulsed laser acts on the brain; and in the ultrasound imaging mode, control the distributed ultrasound transducer array to transmit the ultrasound signal and receive the ultrasound echo signal returned after the pulsed laser acts on the brain; the data acquisition card is configured to: collect the photoacoustic signal or ultrasound echo signal received by the distributed ultrasound transducer array and transmit it to the computer; The computer is configured to: in a multi-spectral imaging mode, use the light intensity of each receiving optical fiber at multiple moments continuously detected by the area array image sensor, and calculate the oxygenated hemoglobin concentration and the deoxygenated hemoglobin concentration at different depths according to the detected light intensity; in a photoacoustic imaging mode and an ultrasonic imaging mode, reconstruct a photoacoustic image or an ultrasonic image according to the photoacoustic signal or ultrasonic echo signal collected by the data acquisition card.
